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FOREWORD 


The  research  work  in  this  report  was  performed  by 
Thompson  Ramo  Wooldridge  Inc.  ,  RW  Division,  Canoga 
Park,  California,  for  the  Flight  Dynamics  Laboratory, 
Directorate  of  Aeromechanics,  Deputy  for  Technology, 
Aeronautical  Systems  Division,  Wright-Patterson  Air 
Force  Base,  under  AF  Contract  Nr.  AF(657)-7459. 

This  research  is  part  of  a  continuing  effort  to  obtain 
economical  methods  of  vibration  prediction,  control  and 
measurement  for  flight  vehicles  which  is  part  of  the 
Air  Force  Systems  Command's  Applied  Research  Program 
750A,  the  Mechanics  of  Flight.  The  Project  Nr.  is  1370, 
"Dynamic  Problems  in  Flight  Vehicles,"  and  Task  Nr.  is 
137009,  "Methods  of  Vibration  Prediction,  Control  and 
Measurement."  C.  L.  Pao  of  the  Flight  Dynamics  Labora¬ 
tory  was  the  Project  Engineer. 

The  authors  express  their  appreciation  for  the  con¬ 
tribution  of  C.  L.  Pao,  R.  N.  Bingman,  and  O.  R.  Rogers. 
Contributing  personnel  of  Thompson  Ramo  Wooldridge 
Inc.  ,  RW  Division,  include  J.  S-  Bendat,  L.  D.  Enochson, 

G.  H.  Klein,  and  A.  G.  Pier  sol. 
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ABSTRACT 


This  report  presents  results  from  theoretical  and  experimental 
studies  on  random  signal  estimation  and  measurement  pertinent  to 
flight  vehicle  vibration  problems.  The  report  is  divided  into  two 
self-contained  parts  corresponding  to  the  theoretical  and  experimental 
programs. 

Part  I,  Theoretical  Studies  of  Random  Signal  Estimation,  develops 
new  basic  mathematical  ideas  for  nonstationary  data  analysis.  The 
discussion  includes  methods  for  estimating  mean  values  and  mean 
square  values  of  nonstationary  data,  correlation  and  spectral  properties 
of  nonstationary  data,  and  various  input-output  relations  for  passage 
of  nonstationary  data  through  linear  systems.  These  results  are 
illustrated  on  examples  of  physical  interest.  Other  theoretical  material 
discusses  sampling  formulas  for  gathering  a  minimum  amount  of  sampled 
data  for  flight  vehicle  vibration  problems.  Analysis  of  variance  pro¬ 
cedures  are  explained  for  carrying  out  accurate  statistical  calculations 
of  an  over-all  vibration  environment  at  many  points  on  an  extended 
structure  using  sampled  data  obtained  from  one  or  many  flights.  A 
summary  review  is  given  of  known  technical  results  dealing  with  the 
response  of  nonlinear  systems  to  random  excitation. 

Part  II,  Experimental  Studies  of  Random  Signal  Measurements, 
investigates  previously  derived  theoretical  expressions  for  expected 
measurement  uncertainties  in  zero  crossing  estimates,  power  spectra 
(mean  square)  estimates,  and  amplitude  probability  density  estimates. 
These  uncertainty  expressions  are  tested  experimentally  by  a  properly 
designed  statistical  program  vhich  demonstrates  how  significant  and 
accurate  information  can  be  obtained  with  a  limited  amount  of  data. 

New  theoretical  uncertainty  formulas  are  derived  which  are  subjected 
to  experimental  and  statistical  check.  From  these  uncertainty  formulas, 
the  remaining  experiments  establish  new  statistical  procedures  for 
determining  the  fundamental  properties  of  randomness,  stationarity, 
and  normality. 
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PART  I 


THEORETICAL  STUDIES  OF  RANDOM  SIGNAL  ESTIMATION 
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1 .  INTRODUCTION  AND  SUMMARY  OF  MAIN  RESULTS 


1 .  1  REVIEW  OF  PREVIOUS  CONTRACT 

The  present  contract  is  a  continuation  of  a  previous  contract  spon¬ 
sored  by  the  Aeronautical  Systems  Division,  Wright -Patter son  Air  Force 
Base,  Ohio,  on  "The  Application  of  Statistics  to  the  Flight  Vehicle 
Vibration  Problem ASD  TR  61-123,  December  1961,  Contract  AF33(6l6)-7434, 
(ASTIA  No.  AD  271  913).  The  general  problem  indicated  by  the  title  of  the 
first  contract  is  covered  from  several  directions,  and  results  are  developed 
which  are  applicable  to  many  other  classes  of  physical  data  besides  vibration 
data.  A  brief  summary  of  the  objectives  and  results  of  this  previous  work 
will  be  given  here. 

The  objectives  of  the  above  contract  were  to  determine  the  vibration 
environment  at  an  arbitrary  single  point  on  a  structure  of  a  flight  vehicle 
during  its  entire  operational  life  history.  No  limitations  were  placed  on  the 
nature  of  the  structure,  whether  linear  or  nonlinear,  whether  it  had  a 
complicated  geometrical  configuration,  or  whether  there  were  complicated 
feedback  loops  and  interconnections.  Also,  no  limitation  was  placed  on  the 
nature  of  the  various  exciting  forces  that  were  acting  upon  the  structure, 
either  as  to  their  location,  or  statistical  nature.  Some  of  these  exciting 
forces  might  be  transient,  some  might  be  localized,  others  distributed, 

-Some  with  stationary  characteristics,  others  quite  random  or  completely 
nonstationary.  The  main  objective  of  the  analysis  is  that  on  the  basis  of 
empirical  information,  a  complete  scientific  statistical  evaluation  of  the 
important  characteristics  contained  in  the  data  has  to  be  made.  It  is  re¬ 
quired  to  predict  the  actual  vibration  environment  that  is  encountered  or 
that  could  occur  under  similar  conditions  so  as  to  assist  future  fatigue  and 
reliability  investigations. 

Engineering  aspects  of  four  different  categories  of  aircraft  and 
missiles  were  considered,  namely  (i)  short-term  missiles,  (2)  space  vehicles 
and  probes,  (3)  long-term  missiles,  and  (4)  rocket  or  jet  powered  aircraft. 

Each  of  these  types  were  broken  down  into  significant  flight  phases,  and 
analyzed  as  to  their  dominant  vibration  and  acoustic  sources.  Results  were 

Manuscript  released  by  the  authors  31  October  1962  for  publication  as  an 
ASD  Technical  Documentary  Report. 
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developed  for  the  response  of  structures  to  periodic  and  random  disturbances, 
and  a  survey  was  made  of  known  experimental  data  obtained  by  various 
investigators . 

Principal  theoretical  activites  of  the  contract  were  divided  into  three 
phases  as  follows: 

Phase  I  Development  of  sampling  techniques  for  decreasing 
the  amount  of  data  to  be  gathered  for  later  detailed 
analysis . 

Phase  II  De  velopment  of  statistical  techniques  for  testing 

fundamental  assumptions  in  data  of  (a)  randomness, 

(b)  stationarity ,  and  (3)  normality. 

Phase  III  Detailed  examination  of  desired  measurements  for 
different  applications  such  as  amplitude  probability 
density  functions,  correlation  functions,  power 
spectral  density  functions  ,  etc. 

During  the  course  of  the  investigation,  many  mathematical  and 
statistical  ideas  were  explored  in  a  broad  way  so  as  to  be  applicable  to 
physical  problems,  such  as  occur  in  structural  design  problems.  Various 
statistical  concepts,  tables,  and  curves  were  presented,  including  the 
normal  (Gaussian)  distribution.  Chi-square  distribution,  "t"  distribution, 

"F"  distribution,  quality  control  procedures,  analysis  of  variance  techni¬ 
ques,  multiple  regression  techniques,  etc.  Detailed  procedures  were 
developed  for  carrying  out:  (1)  a  complete  analysis  on  results  that  would 
be  obtained  from  a  single  experiment,  and  (2)  a  complete  analysis  of 
appropriate  results  from  a  collection  of  experiments. 

In  addition  to  the  theoretical  work,  the  contract  also  involved  carry¬ 
ing  out  an  instrumentation  study  of  equipment  available  today  for  making 
desired  measurements,  with  emphasis  on  their  practical  physical 
limitations  and  accuracies.  An  experimental  program  was  outlined  for 
verifying  the  statistical  procedures  that  were  developed  and  the  various 
instrumentation  accuracies. 

Many  physical  results  on  the  response  of  structures  under  various 
conditions  were  also  obtained  during  the  course  of  the  contract.  These 
physical  applications  include  response  of  structures  to  various  types  of 
random  excitation,  modification  of  response  due  to  loading, analysis  of 
fatigue  properties,  and  nonlinear  effects.  All  of  these  results  are 
discussed  in  detail  in  the  final  report  ASD  TR  61-123,  December  1961. 
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1 . 2  OBJECTIVES  OF  PRESENT  CONTRACT 


The  present  contract,  "Advanced  Concepts  of  Stochastic  Processes 
and  Statistics  for  Flight  Vehicle  Vibration  Estimation  and  Measurement," 
Contract  AF  33(657) -7459 ,  was  sponsored  by  the  Aeronautical  Systems 
Division  to  extend  and  continue  the  work  discussed  above.  This  new  contract 
was  divided  into  both  theoretical  and  experimental  programs. 

On  the  experimental  side,  a  complete  laboratory  program  was  to  be 
carried  out  to  verify  the  analytical  techniques  developed  for  decreasing  the 
amount  of  data  to  be  gathered,  testing  fundamental  assumptions,  and 
making  desired  measurements  from  single  experiments  and  from  repeated 
experiments . 

This  experimental  program  was  deemed  to  be  of  great  importance 
for  establishing  practical  limitations  to  be  attached  to  previous  theoretical 
work.  A  major  objective  was  to  show  how  an  experimental  program  should 
be  designed  along  statistical  lines  so  as  to  obtain  significant  information 
with  a  limited  amount  of  data.  The  tests  for  fundamental  assumptions 
involved  new  concepts  which  had  never  been  tested  experimentally  before. 

It  was  expected  that  further  theoretical  refinements  and  improved 
procedures  would  be  found.  It  was  desired  to  determine  the  accuracy  of 
various  vibration  measurements  for  a  wider  range  of  operating  conditions 
than  had  been  considered  elsewhere. 

The  experimental  program  was  divided  into  three  main  areas: 

(1)  Verification  of  statistical  accuracy  of  measurements, 

(2)  Verification  of  fundamental  assumption  tests, 

(3)  Verification  of  statistical  procedures  for  repeated 
experiments  and  sampling  techniques. 
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On  the  theoretical  side,  greater  emphasis  was  now  to  be  placed  on 
joint  statistical  estimation  procedures  for  obtaining  area  (multiple  point) 
information  of  a  vibration  environment  as  opposed  to  single  point  infor¬ 
mation.  Measurable  results  expected  from  point  to  point  on  an  extended 
structure,  as  obtained  from  one  or  many  flights,  were  to  be  studied 
theoretically  so  as  to  lead  to  appropriate  mathematical  methods  for 
evaluating  this  information.  Practical  limitations  in  these  procedures, 
sampling  considerations,  and  statistical  accuracy  of  the  results  were 
important  requirements  of  the  analysis. 

Another  theoretical  objective  was  to  investigate  effects  of  nonlinearities 
on  structural  vibration  responses.  In  particular,  a  survey  was  desired  of 
known  technical  work  devoted  to  these  nonlinear  matters  so  as  to  expose 
existing  problem  areas. 

A  final  theoretical  objective  was  to  study  characteristics  of  non- 
■tationary  random  vibration  processes  and  to  try  to  develop  appropriate 
methods  for  their  analysis.  This  topic  was  not  studied  during  the  first 
contract.  It  was  recognized  that  the  whole  subject  of  the  nonstationary  data 
analysis  was  a  major  unsolved  problem,  and  that  considerable  effort  might 
be  devoted  here  without  achieving  significant  results.  The  importance  of 
nonstationary  random  processes,  however,  made  this  topic  worthy  of 
special  attention. 

The  theoretical  program  was  divided  into  four  main  areas; 

(1)  Mathematical  methods  for  analyzing  nonstationary  data. 

(2)  Statistical  procedures  for  evaluating  data  from  many 
points . 

(3)  Survey  of  methods  for  predicting  the  response  of  nonlinear 
systems  to  random  vibration. 

(4)  Further  study  on  sampling  techniques  with  consideration  to 
results  from  experimental  program. 
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1 .  3  PERSONNEL  OF  CONTRACT 


The  same  RW  personnel  worked  on  this  contract  as  in  the  first  con¬ 
tract  with  Dr.  J.  S.  Bendat  acting  as  project  manager.  He  was  responsible 
for  promoting  mutual  awareness  and  joint  participation  on  different  problem 
areas,  and  for  assigning  and  reviewing  work  performed  by  the  other  personnel. 
The  theoretical  program  was  of  particular  concern  to  him,  and  his  main  con¬ 
tributions  there  were  devoted  to  developing  the  methods  for  analyzing  non- 
stationary  data  which  are  discussed  in  this  report. 

The  experimental  program  was  directed  by  Mr,  A.  G.  Piersol. 

Mr.  Piersol  carried  out  many  parts  of  the  experimental  program  by  himself, 
from  initial  statistical  design  to  instrument  calibration  to  final  evaluation, 
and  he  was  responsible  for  formulating  several  new  theoretical  improve¬ 
ments  to  previously  suggested  tests  which  made  the  tests  more  precise  and 
more  practical. 

Two  other  men  from  RW  contributed  greatly  to  the  project: 

Mr.  G.  H.  Klein  and  Mr.  L.  D.  Enochson.  Mr.  Klein  was  responsible  for  the 
theoretical  section  in  this  report  which  discusses  analysis  of  variance  pro¬ 
cedures  for  evaluating  vibration  data  from  many  points,  as  well  as  for  origin¬ 
ating  some  of  the  basic  material  discussed  under  sampling  considerations.  He 
conducted  also  the  review  study  on  the  response  of  nonlinear  systems  to  ran¬ 
dom  excitation.  Mr.  Enochson  worked  on  the  statistical  design  of  experiments 
that  were  carried  out  for  the  experimental  program,  and  assisted  in  the  re¬ 
duction  and  interpretation  of  the  collected  data.  He  studied  also  the  statistical 
problems  relating  to  the  analysis  of  variance  procedures. 

A  small  subcontract  was  given  to  the  Norair  Division  of  Northrop 
Corporation  to  provide  laboratory  facilities  for  parts  of  the  experimental 
program.  The  assistance  of  Mr.  Warren  L.  Tribble  of  Norair  in  performing 
the  experiments  was  of  great  help  to  the  success  of  these  experiments. 
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1.4  SUMMARY  OF  MAIN  RESULTS 
1.4.1  Theoretical  Program 

Significant  new  theoretical  results  are  developed  in  Part  I  of  this 
report  for  analyzing  nonstationary  data  by  appropriate  mathematical 
models  and  formulas.  Starting  from  first  principles,  the  investigation 
includes: 

Explanation  of  differences  in  analysis  required  for  nonstationary 
data  versus  stationary  data . 

Formulation  of  essential  parameters  required  for  statistical 
confidence  in  nonstationary  data  measurements. 

*  Methods  for  evaluating  mean  value  estimates  and  mean  square 
value  estimates  of  nonstationary  data. 

>1'  Formulas  for  defining  correlation  functions  and  spectral  density 
functions  of  nonstationary  data. 

Procedures  for  determining  input-output  relations  for  non¬ 
stationary  data  through  linear  systems. 

’i*  Illustration  of  these  techniques  on  various  examples  of  physical 
interest. 

Other  important  theoretical  material  in  Part  I,  which  extends 
previous  work  carried  out  in  the  first  contract  as  well  as  complies  with 
the  objectives  in  the  present  contract,  is  concerned  with: 

Establishment  of  sampling  considerations  for  flight  vehicle 
vibration  problems. 

*  Evaluation  of  vibration  data  from  many  points  on  an  extended 
structure  as  obtained  during  one  or  many  flights. 

Application  of  analysis  of  variance  procedures  to  a  wide  class 
of  problems . 

*  Review  of  various  known  results  on  the  response  of  nonlinear 
systems  to  random  excitation. 
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1.4.2  Experimental  Program 


The  experimental  program  is  discussed  fully  in  Part  II  of  this 
report.  Significant  results  of  the  experimental  program  include: 

*  Greater  understanding  of  application  areas  for  previous 
theoretical  work. 

’i*  Establishment  of  new  improved  theoretical  and  experimental 
procedures  to  test  fundamental  assumptions  of  randomness, 
stationarity ,  and  normality. 

*  Verification  of  theoretical  statistical  uncertainty  formulas  for 
experimental  measurements  of  zero  crossing  estimates,  power 
spectra  (mean  square)  estimates,  and  amplitude  probability 
density  estimates. 

*  Accuracy  of  these  statistical  uncertainty  formulas  proved  experi¬ 
mentally  over  a  wide  range  of  practical  center  frequencies,  band- 
widths,  and  record  lengths. 

*  Demonstration  of  the  importance  of  the  statistical  design  of 
experiments  to  obtain  maximum  information  from  a  limited 
amount  of  data . 

’i*  Appreciation  for  the  improvement  in  statistical  conclusions  that 

can  be  drawn  from  repeated  experiments  over  single  experiments. 

1.5  THE  TWO  PARTS  OF  THE  REPORT 

This  report  is  divided  into  two  parts  corresponding  to  the  separate 
theoretical  program  and  experimental  program,  respectively.  During 
the  course  of  the  experimental  program,  new  theoretical  results  were 
obtained  pertinent  to  the  experimental  work  which  are  included  with  the 
experimental  material.  Previous  theoretical  formulas  for  the  experi¬ 
mental  program  are  summarized  with  the  experimental  material.  Thus, 
Part  II,  Experimental  Studies  of  Random  Signal  Measurements,  is  self- 
contained  and  may  be  read  completely  independent  of  Part  I,  Theoretical 
Studies  of  Random  Signal  Estimation. 
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2.  MATHEMATICAL  METHODS  FOR  ESTIMATING 
MEAN  VALUES  OF  NONSTATIONARY  DATA 


2.  1  INTRODUCTION 

Consider  a  single  record  )c(t)  which  is  a  member  of  an  arbitrary 
random  process  ^ j  whose  statistical  properties  change  with  time  t. 
This  single  record  is  not  required  to  be  representative  of  any  other  record 
except  itself.  Time  averages  computed  over  this  single  record  do  not  have 
to  agree  with  corresponding  ensemble  averages  computed  over  the  entire 
collection  of  records.  Detailed  statistical  analysis  of  this  single  record, 
therefore,  will  yield  little  information  for  predicting  the  behavior  of  the 
ensemble  of  records  to  which  it  belongs.  Such  a  single  record  x(t)  is  said 
to  be  nonstationary  and  the  ensemble  i®  said  to  be  a  nonstationary 

random  process. 

This  description  of  nonstationary  data  fits  many  physical  problems. 
Examples  in  the  flight  vehicle  vibration  area  include  data  gathered  during 
take-off  phases,  during  transition  zones  between  missile  stage  separations, 
and  during  rapid  deceleration  landing  periods.  Shock  phenomena  and  other 
transient  phenomena  would  also  be  considered  nonstationary. 

In  order  to  analyze  nonstationary  data  properly,  it  is  necessary  to 
gather  many  samples  of  the  data  and  to  compute  appropriate  ensemble 
averages  over  these  records.  The  results  will  be,  in  general,  a  function 
of  the  particular  times  at  which  these  averages  are  taken,  and  will  also  be 
a  function  of  the  number  of  available  records.  The  accuracy  of  the  quanti¬ 
ties  being  estimated  will  depend  also  upon  the  underlying  signal  and  noise 
properties  at  these  particular  times. 

Material  in  this  report  for  evaluating  nonstationary  data  is  developed 
in  five  sections.  Statistical  concepts  for  measuring  mean  values  of  non¬ 
stationary  data  are  covered  in  this  section.  Section  3  extends  this  treat¬ 
ment  to  problems  of  estimating  nonstationary  mean  square  values.  This  is 
followed  in  Section  4  by  theoretical  material  devoted  to  nonstationary 
correlation  functions  and  spectral  density  functions.  Section  5  then  dis¬ 
cusses  input-output  relations  for  nonstationary  random  processes  through 
linear  systems,  after  which  a  special  important  physical  example  is 
developed  in  Section  6  to  illustrate  the  various  derived  formulas. 
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2.  2  MATHEMATICAL  MODEL 

Consider  a  random  process  f(t)  which  is  composed  of  the  sum  of 
a  signal  process  8(t)  and  an  independent  noise  process  n{t).  Let 
l^f.(t)]  ,  i  =  1,  2,  .  .  .  ,  N.  05  t  5  L,  be  N  samples  of  f(t).  The  time  t 
in  each  f.(t)  is  required  to  be  measured  from  a  well-defined  origin. 
The  f.(t)  represent  an  ensemble  of  functions  over  which  ensemble 
averages  will  be  taken  at  fixed  values  of  t.  Thus,  results  will  apply 
to  nonstationary  data  where  these  ensemble  averages  change  with  time. 
See  Figure  2.  1. 


f.(i» 
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Assume  that  the  noise  process  |^m(t)j  at  any  time  t  has  an  ensemble 

mean  value  of  zero  and  a  variance  of  Let  the  signal  process 

2 

have  a  population  mean  value  of  p(t)  and  a  variance  of  c  (t).  Then  since 

s 

L(t)  =  s^(t)  +  n^(t),  where  and  ^n^(t)j  are  independent,  it  follows 

that  the  ensemble  averages,  denoted  by  angular  brackets,  are 


^f.(t)^  =  ^8.(t)^  =  p(t)  (2.  1) 

=  ^f.^t)^  -  p^t)  =  (2.  2) 


For  stationary  data,  these  quantities  would  be  independent  of  time. 

The  problem  at  issue  is  to  determine  how  closely  one  can  estimate 
p(t)  by  averaging  a  sufficiently  large  number  of  the  L(t)  so  as  to 
reduce  the  interfering  noise  effects. 

At  any  time  t,  an  average  response  computer  calculates  a  sample 
mean  value  m(t)  from  a  sample  of  size  N  as  given  by 


m(t)  =  - 
N 


(2.3) 


The  quantity  m(t)  is  a  random  variable  which  differs  over  different 
choices  of  the  N  samples  >  i  =  1,  2,  .  .  .  ,  N.  These  different 

choices  of  the  N  samples  b®  denoted  by  > 

k  =  1,  2,  .  .  .  ,  M.  Then,  for  a  fixed  index  i,  ensemble  averages  over  the 
index  k  as  M  approaches  infinity  yields 


lim  — 
M-*oo  ^ 


p(t) 


(2.  4) 
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The  mean  value  of  the  sample  mean  m(t)  over  all  possible  choices  of 
N  samples  is  now 


(2.  5) 


This  result  is  independent  of  the  sample  size  N,  but  is  a  function  of  time 
for  nonstationary  data.  Thus  the  expected  value  of  m(t)  as  calculated  by 
an  average  response  computer  is  the  desired  value  p.(t).  In  statistical 
language,  m(t)  is  an  unbiased  estimate  of  p(t). 

The  next  problem  is  to  estimate  the  variance  associated  with  this 
measurement. 

The  variance  of  the  sample  mean  is  defined  by 


Further  analysis  is  now  governed  mainly  by  the  nature  of  the 
second  summation  above.  Three  cases  will  be  distinguished  here  accord¬ 
ing  to  whether  or  not  f^(t)  and  j  are  (1)  independent,  (2) 

dependent  through  a  common  signal  Sj(t)  in  both  f^(t)  and  fj(f)  hy  the 
condition  ^fj(t)r(t)^  =  ^s^^(t)^  for  i^j,  (3)  correlated  in  a  manner  to 
be  defined  later. 
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CASE  1.  Independent  Samples 

If  f^(t)  is  independent  of  f.(t)  for  all  i  ^  j,  then  there  are 

2 

(N  -  N)  terms  in  the  second  sum  where  i  ^  j  of  form 
^  f.(t)  fj(t)^  =  ^f.(t)^  ^fj(t)^  =  »x^{t),  while  the  re  are  N  terms  in  the 
first  sum  of  form  ^f^^(t)^  Hence, 


N 

1 

"n 


N  <f.^{t))+  (N^  -  N)  p^t) 


-  p^t)  +  N  p^(t) 


Then, 


1  2  2 
-L  <r/{t)  +  p^(t) 

N  ‘ 


o'^(t) 


_1_ 

N 


<r/(t)  =  ^ 


N 


(2.  8) 


(2.9) 


In  words,  Eq.  (2.  9)  states  that  the  variance  of  the  sample  mean 

at  time  t  equals  the  variance  of  the  original  random  process  divided  by 

2  2 

the  sample  size.  The  quantities  cr^  (t)  and  variances  in 

the  signal  and  noise,  respectively,  at  time  t.  For  large  N,  the  variance 
2 

approaches  zero.  Hence,  m{t)  is  a  consistent  estimate  of  p(t). 

This  result,  it  should  be  emphasized,  is  only  for  the  case  when  the 
records  f^(t)  =  s.(t)  +  n^(t)  and  fj(t)  =  Sj(t)  +  statistically 

independent  for  i  ^  j.  To  be  specific,  for  i  ^  j,  ^r{t)fj(t)^  must  be 
given  by  ^f^(t)  ^  ^r(t)  ^  or  one  would  not  satisfy  the  requirements  here. 
More  general  formulas  to  handle  situations  when  r(t)  and  fj(t)  are 
dependent  will  be  developed  later. 
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In  terms  of  signal-to-noise  ratios,  define 


<V‘>> 

p.(t)  = - =  input  signal-to-noise  (amplitude) 


(r^(t) 


ratio  at  time  t 


Define 

Po(t)  =  _  output  signal-to-noise  (amplitude) 

ratio  at  time  t 


From  Eqs.  (2.  1),  (2.  2),  (2.  8),  and  (2.  9),  one  proves 


(2.  10) 


(2.  11) 


p^(t)  =  Pi(t)  (2.  12) 

showing  that  for  a  given  input  ratio,  the  output  ratio  improves  directly  as 

the  square  root  of  the  number  N  of  samples.  The  relation  of  Pq(1)  to 

2  2 

the  input  variance  ratio  <r^  (t)/(r^  (t)  is  expressed  also  in  Eq.  (2.  12). 

By  definition 


(2.  13) 


assuming  o'  (t)  ^0.  If  a  (t)  =  0,  then  the  following  equations  would  have 
s  s 

to  be  modified  by  using  p^(t)  =  f  p,  t)/(r^(t)  j  .  Let 


- i— LJ —  =  A(t),  a  dimensionless  quantity  (2.  14) 

crg(t) 

A(t)  is  the  ratio  of  the  signal  mean  value  to  its  standard  deviation. 

It  is  clear  that  if  p(t)  =  0,  then  Eqs.  (2.  12)  to  (2.  14)  all  equal  zero 
for  all  t  so  that  no  improvement  occurs.  Thus,  results  derived  here 
show  that  an  average  response  computer  will  give  a  zero  output  when  the 
desired  signal  has  p  (t)  =  0.  For  these  situations,  a  more  sophisticated 
analysis  will  be  required  such  as,  perhaps,  the  analysis  of  autocorrelation 
functions  if  other  signal  properties  are  desired. 
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Assuming  ^.(t)  $  0,  substitution  of  Eqs.  ( 2. 1  3)  and  (2. 1 4)  into  Eq.  (2,12) 


yields  for  the  output  signal-to-noise  ratio 


Po(t)  = 


A(t) 


[-1 


2  ,  2 
O'  (t)  /  o 
n  '  '  s 


(.))] 


1/2 


(2.15) 


A(t)  VTT 

[a  ■  iT ; VitTf 

_  n  s 


i, 

T„(t) 


'"/‘‘I’ 


(2.16) 


These  last  two  equations  show  that  the  output  signal-to-noise  ratio  is  always 

directly  proportional  to  "'/IT,  and  inversely  proportional. to  0^(1)  /  *^(^)  when 

2  .  .  2 

the  noise  variance  <t  (t)  is  large  compared  to  the  signal  variance  o  (t). 

n  “ 

In  order  to  compensate  for  a  large  expected  input  ratio  of  o  (t) /o  (t),  it 

n  8 

is  required  to  increase  N  accordingly. 

For  example,  suppose  (cr  /o"  )=  10  at  some  particular  time  and  one 

tl  8 

desires  (p^/A)  =  1.  Then, it  is  necessary  that  N  =  100  samples.  For  a 
case  when  N  =  25  samples,  if  follows  that  (p^/A)  =  0.  5. 

In  order  to  have  (p^/A)=  1  when  N  =  25,  the  maximum  allowable  ratio  for 
(<r  /cr  )  would  be  V'24  ^4.  90. 

Equation (2.1 5)  is  one  of  the  important  results  of  this  section.  Table  2.  1, 

plotted  in  Figure  2.2,  shows  the  quantity  p^(t)/A(t)  as  a  function  of  N  for 

given  values  of  cr  (t)/cr  (t).  In  actual  practice,  the  quantity  A(t)  will  in 
tl  s 

many  situations  be  larger  than  unity.  The  output  ratio  Pq(1)  itself 
will  be  A(t)  times  the  values  shown  on  the  vertical  scale. 
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O'  /ff 

n  s 


.  5 


1.0 


2. 


5. 


10.  0 


40 

50 

60 

5.  6 

6.  3 

6.  9 

EB 

5.  0 

5.  5 

2.  9 

3.  2 

3.  5 

1.  24 

1.  40 

1.  52 

.9  8.4 


8.  9 


7.  1 


.5  4.  7  4.  9 


1.  97  2.  06  2.  15 


0.  32  0.  45  0.  55  0.  63  0.  71 


0.  95 


Table  2.  1  Data  fol-  Figure  2,  2  from  Eq.  (2. 15) 

10 

9 

e 

7 

6 

^  5 

Alt) 

4 

3 

2 

I 

10  20  30  40  50  60  70  80  90  100  HO  120 

N 

Figure  2.  2  Plot  of  pQ(t)/A(t)  as  function  of  N  for  various  0'^(t)/o'^(t) 
from  Eq.(2.  15) 
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CASE  1.  Confidence  Limits 


A  knowledge  of  the  mean  value  and  variance  for  the  random  variable 
m(t)  at  any  time  t  enables  one  to  answer  questions  concerning  the  range 
of  the  results  at  any  time  t  without  knowing  the  exact  probability  distri¬ 
bution  function  for  m(t).  From  the  Tchebycheff  Inequality,  which  applies 
to  arbitrary  general  situations,  one  may  state  with  89%  confidence,  for 
example,  that  an  observed  measurement  for  m(t)  lies  inside  the  range 

|ji(t)  -  3<r  (t),  p(t)  +  3(r  (t)  .  In  equation  form,  for  any  constant  X.,  thfe 

t  m  m  -I 

Tchebycheff  Inequality  is 


Prob 


|m(t)  -  pt  (t)|  » 


(2.  17) 


Thus,  for  k  =  3,  the  probability  is  at  most  (1/9),  giving  the  above  89% 
confidence  limits.  See  Figure  2.  3. 


m{t) 


t 

Figure  2.  3  89%  Confidence  Limits  for  Arbitrary  Distribution 

A  stronger  statement  can  be  made  if  one  can  justify  an  assumption 
that  ni(t)  follows  a  normal  (Gaussian)  distribution  at  any  value  of  t.  For 
this  special  case,  a  95%  confidence  band  is  given  by  the  range  |  p.(t)  -  2(r^t), 
pL(t)  +  2(rrj(t)]  .  Thus,  an  observed  measurement  for  m(t)  in  the  Gaussian 
case  yields  a  greater  confidence  of  being  close  to  the  theoretical  mean 
value  p.(t)  than  before. 
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Consider  the  range  for  m(t)  as  given  by 

|m{t)  -  ±  (2.18) 

where  k  is  a  constant.  Solving  for  m(t)  yields  the  two  extreme  range  values 

m{t)  =li(t)  ±  ko-  (t)  (2.19) 

m 

Upon  substitution  of  the  general  expression  for  from  Eq.  (2. 9), one  finds 


m(t)  =  p(t)  i  X. 


<r/(t)  +  crn^t) 


Vn" 


=  p(t)  ±  ko-^(t) 


1 


1/2 


Vn" 


(2.20) 


Hence,  by  increasing  N,  one  may  guarantee  that  rr(t)  will  fall  close  to 
p.(t),  regardless  of  the  magnitude  of  the  other  variables. 

Equation  (2.20)  can  be  put  into  another  equivalent  form  by  using  Eq(2.15). 
This  yields  a  new  interesting  expression 


m(t)  =  fi.(t)  ±  \ 


^(t) 

P„(t) 


(2.21) 


Now,  on  solving  for  p(t),  one  derives 


P(t)  = 


m(t) 


for 


p^(t)^k 


(2.22) 


ii[^/p^(t)] 

which  shows  how  range  values  for  m{t)  are  related  to  the  output  signal- 
to-noise  (amplitude)  ratio  p^(t),  and  to  the  constant  X.  determining  the 
confidence  limits.  Clearly,  for  good  results,  PQ(t)  should  be  as  large 
as  possible  relative  to  \  in  order  for  m(t)  to  approximate  p(t). 

Equation  (2.22),  like  Eq.  (2.1  5),  is  a  major  result  of  this  section.  From 
Eq(2.22),  for  example,  if  \  =  3  and  p^(i)  =  then  for  an  unspecified 
probability  distribution  function  associated  with  m(t),  the  Techebycheff 
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Inequality  yields  89%  confidence  that  |i.(t)  lies  in  the  range  bounded 


k(0  =  1  £  I  //2)  ~  -y  2m(t) 


Thus,  one  measures  m(t)  and  then  applies  the  above  bounds  to  estimate 


p(t).  If  a  Gaussian  distribution  is  assumed,  then  for  \  =  2  and  =  6, 

one  can  state  with  95%  confidence  that  p  (t)  lies  in  the  smaller  range 
bounded  by 


^x(t)  = 


m{t) 

1  ±  (l/3) 


Figure  2.4  based  on  Eq.  (2.22)  is  a  plot  of  the  ratio  p(t)y/m(t)  as  a 
function  of  Two  cases  are  considered.  Case  1  applies  to  arbitrary 

probability  distributions  and  sets  X.  =  3,  corresponding  to  an  89%  con¬ 
fidence  band  as  given  by  the  Tchebycheff  Inequality.  Case  2  applies  to 
a  Ganssian  probability  distribution  and  sets  \  =  2,  corresponding  to  a 
95%  confidence  band.  The  lower  and  upper  limits  used  for  Figure  2.  4  are 
shown  in  Table  2.  2, 

Substitution  of  Eq.  (2.1  2)  into (2. 22)  yields  a  useful  general  result 


HLd)  = 


m(t) 


X/yN  p.(t)J 


Vn  p.{t) 


(2.23) 


which  shows  how,  for  given  values  of  X.  and  p^(t),  one  can  make  m(t) 
fall  arbitrary  close  to  p(t)  by  proper  choice  of  N.  Note  that  if  p^(t) 
is  assumed  to  be  unity,  then  p^it)  =  For  this  case,  the  numbers 

shown  in  Table  2.2  and  Fig.  2.4  can  be  interpreted  quite  simply  in  terms  of 
sample  size  N.  For  example,  p^lt)  =  10  would  correspond  to  N  =  100 
and  p^lt)  =  20  corresponds  to  N  =  400. 
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5  To  Ts  25 

p^(t)  =  p^(t) 
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Case  1 

Case  2 

Lower 

Limit 

Upper 

Limit 

Lower 

Limit 

Upper 

Limit 

2 

— 

— 

0.  50 

00 

3 

0.  50 

QO 

0.  60 

3.  00 

4 

0.  57 

4.  00 

0.  67 

2.  00 

5 

0.  63 

2.  50 

0.  71 

1.  67 

6 

0.  67 

2.  00 

0.  75 

1.  50 

8 

0.  73 

1.  60 

0.  80 

1.  33 

10 

0.  77 

1.  43 

0.  83 

1.  25 

12 

0.  80 

1.  33 

0.  86 

1.  20 

15 

0.  83 

1.  25 

0.  88 

1.  15 

18 

0.  86 

1.  20 

0.  90 

1.  12 

20 

0.  87 

1.  18 

0.  91 

1.  11 

25 

0.  89 

1.  14 

0.  93 

1.  09 

Table  2.  2  Data  for  Figure  2.  4 


Equation  (2.  23)  indicates  also  how  a  sample  size  Nj  required 
in  arbitrary  non-Gaussian  cases  is  related  to  the  sample  size  N2 

required  in  Gaussian  cases.  To  illustrate  this  point,  for  an 

arbitrary  distribution  and  arbitrary  input  ratio  p^(t),  the  parameter 

=  3  corresponds  to  an  89%  confidence  band.  For  the  same  input 

ratio  and  the  same  89%  confidence  band,  a  Gaussian  distribution  has 

associated  with  it  the  parameter  From  Eq.  (2.23),  the 

corresponding  sample  sizes  N^,  must  satisfy 


1.  6 


or  Nj  =  3.  5  N2 


Vn  V  Nj  VN2 

Thus,  for  example,  an  acceptable  sample  size  of  N2  =  30  for  an 
89%  confidence  band  with  a  Gaussian  distribution  would  need  to  be 
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increased  to  Nj  =  105  for  an  unspecified  distribution  in  order  to  obtain 
the  same  89%  confidence  band.  Consider  a  different  case  when  =  2, 
corresponding  to  a  75%  confidence  band  from  the  Tchebycheff  Inequality. 
The  associated  Gaussian  parameter  value  is  ^2  -  This  leads  to 


1.  15 


V 


N- 


or  Nj  = 


Now,  =  ^0  would  need  to  be  increased  only  to  Nj  =  90  to  obtain  a 
75%  confidence  band. 

Related  sample  sizes  for  and  as  a  function  of  confidence 

band  are  summarized  in  Table  2.  3.  The  sample  size  Nj  is  the  sample 
size  for  an  unknown  distribution  while  is  the  sample  size  for  a 

Gaussian  distribution 


Confidence 

Band 

N,/N2 

75% 

3.  0 

89% 

3.  5 

92% 

4.  1 

95% 

5  2 

98% 

9.  2 

99% 

15  0 

Nj  =  sample  size  required 

for  unknown  distribution 

=  sample  size  required 
for  Gaussian  distribution 


Table  2.  3  Related  Sample  Sizes  for  Unknown 
Versus  Gaussian  Distribution 
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CASE  2.  Dependent  Samples 

For  this  case,  assume  that  £^(t)  and  fj{t)  have  the  form 


f,(t)  =  s^(t)  +  n^(t) 


(2.24) 


f.{t)  =  s.(t)  +  m(t) 


where  s.(t)  is  a  common  random  signal  in  both  f^(t)  and  ^j(0>  while 
n.(t)  and  Oj(t)  are  noise  terms  independent  of  each  other  and  of  s.(t). 
As  in  Case  1,  the  ensemble  averages  are  given  by 


^f.(t)^  =  ^s.(t)^  =  p(t) 

11^0  + a/(t) 


The  change  from  Case  1  is  in  the  term 


(2.25) 


f.(t)f.(t)^  =  (s^{t)'j  for  i^j 


(2.26) 


Previously  it  was  assumed  that  fj(t)  and  fj(t)  were  independent  for 
i  /  j,  so  that  ^f.(t)r(t)^  =  p^(t). 

Return  now  to  Eq(2.7).  Substitution  from  Eqs.(2.25)  and  (2«26)  into 
Eq.(2.7)  yields 

^  N  +  (N^  -  N)  {.i^(‘)) 

From  Eq(2r5)  and  Eq.(2.26),  the  ensemble  average 

^m(t)^  =  (sjio)  =  H-(0 


(2.27) 


(2.28) 
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{Z.  29) 


Thus , 


(T  (t)  becomes 
m 


cr.^  ’.t)  =  (r^,t)  +  - 


m 


N 


which  is  quite  different  from  Eq.  (2.9)i  the  result  derived  for  Case  1, 

In  words,  Eq.  (2.  29)  states  that  the  variance  of  the  sample  mean  at  time  t 
equals  the  variance  of  the  signal  portion  at  time  t  plus  (1/N)  times  the  variance 
of  the  noise  portion  at  time  t.  For  large  N,  the  variance  approaches 

(TgCt)  which  is  not  required  to  be  zero.  Hence  m(t)  is  no  longer  a  consistent 
estimate  of  K-lt).  Eq.  (2.29)  shows  that  m(t)  is  still,  however,  an  unbiased 
estimate  of  hi-.t). 


Example  1:  Sine  Wave  process  with  dependent  amplitudes. 


s .(t)  =  a.  cos  (u)t  +  0) 


a^  variable,  ^a.aA  =  ^a^  )  / 


^s.(t)^  =  hi{t) 


a^)  cos  (ojt  +  0) 


cos  (wt  +  0) 


2  2  2  2 
O'  (t)  =  cr  cos  (oJt  +  0)  where  cr 

S  3L  3 


~ 


0-  ^(t)  —  cr^(t) 
m  s 


as 


N— ►QO 


2, 


Here,  one  is  not  able  to  uncover  p(t)  as  closely  as  desired  since  o’j^(l)  does  not 
approach  zero  for  large  N.  If  the  amplitudes  were  independent,  would 


approach  zero. 


Example  2:  Sine  Wave  process  with  variable  phase  angles. 


s.it)  =  a  cos  (ojt  +  0.)  ;  a  constant,  0.  variable 

1  1 

^s/[t)^  =  p't)  =  0  for  all  t 
^s^^(t)^  =  (a^/2) 

o-J(t)  =  (aVz) 

Since  p(t)  =  0  here,  an  average  response  computer  will  not  uncover  any  prop 
erties  of  this  signal  except  for  this  fact. 
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CASE  2.  Signal -to  -  Noise  Ratios 


For  the  following  discussion,  assume  that  \i(t)  4  0.  From  Eq8.(2.10) 
and( 2 .1  l),one  finds  for  Case  2  that  the  input  ratio 

<£i(.)> 


Pi(t)  = 


P(t) 


while  the  output  ratio 


(2.30) 


P(t) 


“■  (t) 
m 


+  (<r^^(t)/N)] 


T7z 


(2.31) 


Thus, 


Pi(t) 

r  2  2  ^ 

r  2 

2  11/2 

(2.32) 


Eq(2.33)  proves  that  PQ(t)»p.(t)  for  all  N  »•  1  since  =^[®’„^(t)  /  n], 

assuming  that  ^j^^(t)  4  0. 

As  inEq(2.14),  assuming  p(t)  and  cr  (t)  to  be  different  from 

8 


zero,  let 


A(t)  =  —tS}} 

‘^s(t) 


(2.33) 


In  terms  of  A(t),  Eqs.  (Z.  30)  and  (2.  31)  can  be  written 


Pi(t)  = 


_ A(t) _ 

[  1  +  (‘^n^t)/(r^^(t)] 


(2.34) 


Po(‘) 


A(t)  VIn _ 


(2.35) 


The  latter  important  result  should  be  compared  with  Eq(2f.l5).  Note  that 
in  Eq(2»15),  the  denominator  contains  "I"  instead  of  "N". 


ASD  TDR  62-973 


2-17 


Consider  a  few  special  properties  of  Eq.  (2.  35),  Always 


N 

A(t)  [n+  (<T^2(t)/<r/(t))]‘/^ 
2  2 

since  (a^  (t)  /  (t))»  0.  For  large  N, 


(2.36) 


p^(t) — ►A(t)  as  N — ^oo 


(2.37) 


In  order  for  p^(t)i  1,  it  is  necessary  that 


A(t)^ 


(2.38) 


To  consider  some  numerical  examples,  suppose  some 

particular  time  and  N  =  100.  Then  p  =0.  7A  In  order  to  have 

p  =0.  5A  when  N  =  25,  the  maximum  allowable  ratio  for  (cr  /cr  )  would 
'^o  'ns 

be  VtS^S.  66.  For  this  latter  example,  if  (a  /a  )  =  V  75  and  A  =  10, 

^  ns 

then  p.  ^  1.  15  and  p  =5. 

Table  2.  4,  shows  the  quantity  p^(t)/A(t)  as  a  function  of  N  for  given 
values  of  o'^(t)/<r^(t).  The  actual  output  ratio  Pq(1)  will  be  A(t)  times 
the  value  shown  in  the  table.  It  is  instructive  to  compare  Table  2.  4  with 


Table  2.  1  to  appreciate  the  difference  between  Case  1  and  Case  2. 


N 

(T  /<r 
n  s 

10 

20 

30 

40 

50 

60 

70 

80 

90 

100 

0.  5 

0.  98 

0.  99 

0.  99 

0.  99" 

0.  99"^ 

0.  99'' 

0.  99^ 

0.  99^ 

0.  99'" 

0.  99 

1.  0 

0.  95 

0.  97 

0.  98 

0.  99 

0.  99 

0.  99 

0.  99^ 

0.  99^ 

0.  99'" 

0.  99 

2.  0 

0.  85 

0.  92 

0.  94 

0.  95 

0.  96 

0.  97 

0.  97 

0.  98 

0.  98 

0.  98 

5.  0 

0.  54 

0.  67 

0.  74' 

0.  78 

0.  82 

0.  84 

0.  86 

0.  88 

0,  89 

0.  90 

10.  0 

0.  30 

0.  41 

0.  48 

0.  54 

0.  58 

0.  61 

0.  64 

0.  67 

0.  69 

0.  71 

Table  2.4  Value  of  pJt)/A(t)  as  function  of  N  for  various  (o’^(t) /cr^(t)) 
from  Eq.  (2.  36). 
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CASE  2.  Confidence  Limits 


Confidence  limits  for  Case  2  can  be  calculated  by  using  Eq.(2.19) 
with  the  new  o-  (t)  from  Eq.(2.29).  This  yields 


m 


m(t)  =hi(t)  ±\  [o-g^it)  +  (a^^(t)  /N)] 


1/2 


^(t)  ±  \  ff  (t) 


[N  +  ^{t) 


1/2 


(2.39) 


=  li{t)  ± 


l^{t) 

Po(t) 


upon  substitution  from  Eqs.  (2.  33)  and  (2.  35).  Hence 


P(t)  = 


1  ± 


m(t) 


for 


(2.40) 


Eq,  (2.40)  is  precisely  the  same  form  as  Eq.  (2.22) ,  and  like  Eq.  (2.22)  is  a 
major  result  of  this  investigation. 

Further  analysis  of  Eq.(2.40)would  proceed  exactly  as  was  done 
in  Case  1.  All  results  derived  there,  including  Figure  2.4,  Table  2.2,  and 

Table  2.3  apply  here  without  exception.  In  using  Figure  2.4,  for  example, 
the  only  precaution  is  to  be  sure  that  the  output  ratio  for  PQ(f)  is  given 
by  its  correct  form  for  Case  2,  namely,  Eq.(2.35)  instead  of  Eq.(2.15) 
which  holds  for  Case  1. 
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CASE  3.  Correlated  Samples 


Consider  now  a  general  situation  where 


f.(t)  =  s.(t)  +  n.(t) 

fj(t)  =  8j(t)  +  n^lt) 

such  that  the  ensemble  average  is  defined  by 

<^f.(t)r(t)^  =  <(^s.(t)  8j(t)^  =  R^g(k,  t)  where 


(2.41) 


k  =  j-i  (2.42) 


The  quantity  R  (k,  t)  is  a  nonstationar y  spatial  cross- correlation  func- 
tion  at  time  t  between  the  ith  record  s^(t)  and  the  jth  record  8j(t)  such 
that  j  -  i  =  k.  It  follows  from  the  above  definition  by  interchanging  i  and 
j  that 

R^g(k.t)  =  R^^(.k.t)  (2.43) 

To  illustrate,  this  quantity,  for  N  records,  one  would  set 


<8.^t))  =  <rj(t)  4-  ^^(t)«'  -i 


sf(t)  +  s^(t)  +  . 


..  +  SjJ(t) 


N 


Sj(t)s2(t)+ S2(t)s3(t)+  ...  + 


N-1 


and  so  forth.  The  true  values  are  obtained  as  N  becomes  large. 

If  the  records  have  been  collected  at  regularly  space  time  intervals 

L  apart,  and  if  t  is  measured  from  a  well  defined  origin  in  each  case, 

then  R  (k,  t)  can  be  interpreted  as  the  correlation  existing  at  time  t 
8  8 
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between  records  which  are  kL  apart.  Thus,  R  (k,  t)  can  be  used  to 

s  8 

define  adaptive  changes  (such  as  structural  fatigue  effects  or  physiological 

learning  patterns)  in  the  records  as  a  function  of  repeated  stimuli  which 

produce  the  records.  Refer  to  Figure  2.1  and  consider  fj(t)  to  have  a  time 

scale  O^t^L,  consider  f2(0  to  have  a  time  scale  L^trfZL,  and  so  forth. 

The  precise  form  of  R  (k,  t)  determines  whether  one  has  a  Case  1 

s  s 

situation,  a  Case  2  situation,  or  something  in  between.  To  be  specific,  it 
will  be  shown  shortly  that 


(1)  Rgg(^>  0  for  all  k  I  yields  Case  1 

(2)  Rgg(^>^)  =  k  1  yields  Case  2 

For  the  subsequent  discussion,  assume  as  before  that 
nj(t)  are  independent  of  each  other  and  of  8^{t)  and  8j(t). 
the  ensemble  average 


n.(t)  and 
1 

As  before, 


(f.^t))  =  <8,^1))  +  (n.^(t))  =  Rgs(O.t)  +  (r^^(t)  (2.44) 

Consider  now  Eq.(2.7)and  the  value  of  ^m^(t)^  for  this  case.  Equa¬ 
tion  (2.7)  states  that 

r  N  JN 


= 4  /  <'»  * 

N  LiTi  i.j=l  -I 


(2.45) 


Substitution  from  Eqs.  (2.44)  and  (2.42)  yields 


N(R„(0,t)..r_,2„j)  + 


R„(k.t) 


i,J=l 

k=j-i^0 


(2. 
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Tht*  problem  of  concern  is  the  interpretation  of  the  double  sum  over 

i  and  j.  The  index  k  =  j  -  i  takes  on  values  1,2,...,  N-  1  Altogether, 

2  2 

there  are  N  -  N  terms.  Since  R  (k,  t)  =  R  (-k,  t),  the  (N  -  N)  terms 

ss  ss 

in  this  sum  can  be  arranged  so  that  there  are  two  terms  where  k  =  N  -  1 

of  form  R  (N  -  1,  t),  four  terms  where  k  =  N  -  2  of  form  R  (N  -  2,  t),  . 
s  s  s  s 

and  2(N  -  1)  terms  where  k  =  1  of  form  R  (  1.  t).  Thus,  one  derives 

s  s 

the  simplified  expression 


N 

Rgg(k.t)  =  2\  (N-k)R^^(k,t) 


(2.47) 


i,  J=1 
k=j-i^0 


As  a  check,  note  that  the  sum 

N-  1 

2  ^  (N  -  k)  ^  (N^  -  N)  (2,48) 

k=  1 

Equation ( 2.47)  is  a  key  analytical  result.  Substitution  of  Eq.  (2.47) 
into  Eq.  (2.46)  shows 


Rss(0*O  +  (t) 


+  -4-  7  ^ss'^’^> 


(2.49) 


2  2 

Finally,  since  R  (0,  t)  =  cr  (t)  +  p  (t),  with  the  aid  of  Eq.  (2.48),  the 
s  s  s 

variance  o‘m(0  =  <^rr?(t)  ^  *  M^^(t)  becomes 


2...  +  ^  Z 

or  (t)  =  -  +  - 

N  n' 


N-  1 


(N  -k) 


Rss(k,t)  -  p  (t) 


(2.50) 
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Equation  (2.50)  is  a  major  result  of  this  investigation.  From  it  may  be 
derived  confidence  statements  and  curves,  similar  to  those  found 
previously,  where  Eq.  (2.50)  takes  the  place  of  Eq.  (2.9)  or  Eq.  (2.29). 
Two  cases  of  Eq.  (2.50)  are  worthy  of  special  mention 

(A)  R  „(k,t)=  ^i^(t)  for  all  k»l  (2.51) 

s  s 


From  Eq.  (2<50),  it  follows  that 


N 


(2.52) 


which  is  precisely  Eq.  (2.9)  of  Case  1.  This  situation  assumes 
no  dependence  between  the  signals  in  the  different  records- 

(B)  R_(k.t)  =  (O.t)  =  (rf(t)  +  fi^t)  for  all  k»  1  (2.53) 

S  S  8  9  S 

From  Eqs.  (2.50)  and  (2.48),  it  follows  that 

<r^(t)  =a;(t)  +  -H—  (2.54) 

m  ®  ik-T 


which  is  precisely  Eq.  (2.29)  of  Case  2.  This  situation 
assumes  complete  dependence  between  the  signals  in  the 
different  records. 


For  physical  situations  where  neither  Case  1  nor  Case  2  apply, 
Eq.  (2.50)  gives  a  more  general  expression  to  analyze  nonstationary 
problems  where  a  partial  correlation  exists  between  signals  in  the 
different  records. 
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CASE  3.  Exponential  Correlation  Function 


An  exponential  form  for  the  nonstationary  cross- correlation  func¬ 
tion  now  be  assumed  so  as  to  obtain  some  quantitative 

results  to  characterize  different  degrees  of  correlation.  This  particular 
form  is  known  to  fit  many  physical  situations  and  it  is  therefore  deemed 
appropriate  for  consideration  here.  To  be  specific,  it  will  be  assumed 


that 

R  (k.t)  =  p^(t)  +  cr/(t)e''^*‘'  (2.55) 

S  9 

where  k  and  c  are  positive  constants.  Observe  that  an  extremely 
large  value  for  the  correlation  coefficient  c  corresponds  to  Case  1  while 
an  extremely  small  value  for  c  corresponds  to  Case  2.  Equation  (2.50) 
now  become  s 


N 


(N  -k)e 


-kc 


(2.56) 


To  evaluate  the  sum  above,  let 


N-t 


f(c)  = 


-kc  I-e-<N-‘)^ 


6*^-1 


(2,57) 


Then 


f'(c)  =  -  )  ke  =  - - - 5 - 

(e'"  -  ir 


(2.58) 


Now 


F(c)  =  )  (N  -  k)e‘^^  =  Nf(c)  +  f'(c) 


(N-  l)e^  -  N  + 


y  C  <  .  2 

(e  -  1) 


(2,59) 
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Substitution  into  Eq.(2.56)  gives 


2  +  2a/{t) 

a  ^(t)  =  _J - +  _! - 

m 


N 


N 


/M  4  \  c  . -  ,  -(N-  l)c 

(N  -  1)  e  -  N  +  e  ' 


(e"  -  1)' 


(2.60) 


Equation  (2.60)  can  be  used  to  generate  a  set  of  curves  for  different 

values  of  N  and  c.  For  a  given  value  of  N,  and  for  known  values  of 
2  2 

0"^  (t)  and  (T^  (t),  actual  experimental  results  would  enable  one  to  esti¬ 
mate  the  correlation  coefficient  c. 


2.  3  CONCLUSION 

Results  obtained  in  this  section  may  be  applied  in  many  ways.  These 
results  are  valid  for  nonstationary  data  since  all  averages  are  ensemble 
averages  and  the  various  statistical  quantities  involved  are  allowed  to  change 
with  time.  Three  cases  are  distinguished  according  to  whether  or  not  the 
sample  records  are  (1)  independent,  (2)  dependent,  (3)  correlated.  If 
input  signal  and  noise  variances  are  known,  and  if  the  input  signal-to-noise 
ratio  is  known,  then  one  may  calculate  the  output  signal-to-noise  as  a 
functicn  of  the  sample  size.  The  same  formulas  enable  one  to  decide  in 
advance  how  large  the  sample  size  should  be  to  achieve  a  desired  output 
ratio.  Knowledge  of  the  output  ratio  permits  definite  confidence  bands  to 
be  associated  with  measurements  from  an  average  response  computer. 

Working  backwards  from  the  derived  equations,  if  one  can  estimate 
the  output  ratio  for  a  known  sample  size,  then  one  can  infer  properties 
about  the  input  ratio,  and,  thus,  about  the  underlying  input  signal  and 
noise  variances.  Similarly,  the  ability  to  estimate  the  confidence  band 
associated  with  average  response  computer  measurements  enables  one  to 
estimate  the  output  ratio.  Changes  in  sample  size  are  tabulated  to  achieve 
a  given  confidence  band  for  measurements  following  an  unknown  arbitrary 
distribution,  as  compared  to  measurements  following  a  Gaussian  distribution. 

Estimates  of  an  underlying  noise  variance  alone  can  sometimes  be 
obtained  experimentally  when  no  signal  is  present,  and  of  combined  signal 
and  noise  variances  when  the  signal  is  present.  This  variance  information. 
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together  with  a  corresponding  mean  value  estimate  would  provide  data 
for  estimating  an  input  signal-to-noise  ratio. 

The  Case  3  situation  of  correlated  samples  includes  Cases  1  and  2 
as  special  cases.  This  case  enables  one  to  analyze  adaptive  changes  in 
records  as  a  function  of  repeated  stimuli.  A  quantitative  technique  is 
described,  using  an  exponential  correlation  function,  which  may  help  to 
characterize  different  physical  situations. 
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3,  ESTIMATION  OF  NONSTATIONARY  MEAN  SQUARE  VALUES 


3.  1  INTRODUCTION 

The  previous  section  described  methods  for  analyzing  the  accuracy 
to  be  associated  with  average  response  (mean  value)  computations  on  non¬ 
stationary  data,  The  present  section  continues  this  line  of  analysis  so  as 
to  determine  the  accuracy  to  be  associated  with  mean  square  computations 
on  nonstationary  data.  One  reason  for  the  interest  in  mean  square  values 
IS  that  it  describes  the  "power"  contained  in  the  data  at  any  time  and  thus 
shows  how  the  power  change  with  time.  Another  reason  is  that  the  mean 
value  is  commonly  zero  when  analyzing  random  phenomena  so  that  one  is 
forced  to  consider  higher  moments  such  as  mean  square' values  in  order 
to  describe  the  data. 

For  the  present  treatment,  it  will  be  assumed  that  one  has  available 
a  set  of  N  stationary  or  nonstationary  records  ^  “  1, 2,  ....  N. 

This  set  of  records  is  assumed  to  have  a  well-defined  time  origin  in  each 
case,  such  as  the  closing  of  a  switch,  the  opening  of  a  door,  the  start  of 

an  impact,  etc.  A  mean  square  computer  takes  each  sample  record  T(t), 

2  .  ,  2 
squares  it  to  obtain  f.  (t),  and  then  averages  the  set  of  N  different  L  (t). 

This  provides  an  estimate  of  the  true  mean  square  value  which  would  be 

obtained  if  one  had  available  an  infinitely  large  collection  of  records.  The 

problem  of  this  section  is  to  determine  how  closely  one  can  estimate  the 

true  mean  square  value. 

At  any  time  t,  a  mean  square  computer  calculates  a  sample  mean 
square  value  from  a  set  of  records  size  N  as  given  by 


v(t)  =  i 

N 


(3.  t) 
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The  sample  records  will  be  assumed  to  be  additive  mixtures  of 

independent  signals  ^8^(0 j  and  noise  |^m(t)J  .  Pairs  of  records  fj(t)  and 

f.(t)  where  i  ^  j  will  separate  into  three  cases  according  to  whether  or 
J 

not  they  are  (1)  independent,  (2)  dependent  through  a  common  signal  s^(t) 
in  both  r(t)  and  (3)  correlated  in  a  manner  to  be  defined  later. 

These  three  cases  are  precisely  the  same  three  cases  as  were  considered 
previously  when  analyzing  the  accuracy  to  be  associated  with  average 
response  computers  for  nonstationary  data. 

The  quantity  v.(t)  is  an  unbiased  estimate  of  the  population  mean  square 
value  over  ^f^(t)^  at  any  time  t  since  the  ensemble  average  over  a  set  of 


estimates 


[v(t)  j  is 


%<•> =<»<'>)= 5 y <f '(‘)> - <'"('•> = <■"('») ♦  <3- 2) 


It  should  be  noted  here  that  y.(t)  is  an  estimate  of  the  mean  square  value 
of  the  signal  plus  noise.  A  cross-correlation  procedure  is  required  to 
estimate  the  mean  square  value  of  the  signal  alone. 

The  main  problem  here  is  to  determine  the  variance  associated 
with  the  set  of  estimates  three  cases  of  |^f.(t)j  to  be  con¬ 

sidered.  In  general,  the  variance  is  defined  by 

<rv^(t)  =  <v^t))  -  [<v(t))j^  (3.3) 
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From  Eq,  (3.1),  t.he  mean  square  ensemble  average  ^v^(t) 
term  on  the  right  hand  side  of  Eq.  (3.  3),  is  given  by 


the  first 


(3.4) 


Thus,  the  problem  reduces  to  evaluation  of  the  two  ensemble  averages 


<^f.'^(t)  )  and  <^f.^(t)  E^(t)^  where  i^j 


3.  2  THREE  MATHEMATICAL  MODELS 

Results  will  now  be  developed  for  three  mathematical  models  of 
physical  problems;  Case  1.  Independent  Samples;  Case  2.  Dependent 
Samples;  and,  Case  3.  Correlated  Samples. 


Case  1.  Independent  Samples 

For  this  case,  it  is  assumed  that  the  records 

L(t)  =  s.(t)  +  n.(t) 

f  (t)  =  s  (t)  +  n  (t) 

J  J  J 

are  such  that  ^nj(t)^  =  0  and 

(f.(t))  =  <s.(t))  =  p(t) 

For  i  ^  j,  the  independence  assumption  requires 

(f.(t)f.(t))  =  <(8.(t))  (S.(t))  =  p^t) 


(3.  5) 


(3.  6) 


(3.  7) 


ASD  TDR  62-973 


3-3 


It  follows  that  the  variance 

a/(t)  =  =  cr/(t)  +  (3  8) 

where 

=  <^3.^(t)^  *  >i^(t)  and  =  <^n.^(t)^  (3.9) 

In  order  to  obtain  reasonable  closed-form  quantitative  expressions 
in  the  following  analysis,  and  also  because  it  describes  fairly  closely  a 
wide  variety  of  situations,  it  will  be  assumed  now  that  the  set  of  values 
f^{t)jat  any  time  t  follows  a  Gaussian  (normal)  distribution  with  mean 
value  p(t)  and  variance  One  can  then  derive  for  the  higher  moments 

<^f.^t))  =  3[(r^^t)  +  p^t)]^  -  2  ^x^t)  (3.  10) 

while,  for  i  ^  j,  for  Case  I, 

<^f.V)f.^{t)^  =  [a^^t)  +  p^t)]^  (3.11) 


Eqs,  (3.  10)  and  (3.  11)  follow  from  the  Gaussian  relation 

(£;(t)£^(.)f.(t)y.))  -  <£;(.)£/£))  <£J.)  £„(.))  +  <£.(t)£^(.))  (£,(.)  £„(£)> 

+  <£.(£)  £^(t)  )<£.(£)  £Jt))  -  2  (3,  12) 

as  applied  to  the  two  cases  when  j  =  m  =  n  =  i,  and  when  m  =  i,  n  =  j, 
i  ^  j.  In  deriving  Eq.  (3.11),  use  is  made  of  the  independence  relation  of 
Eq.  (3.7). 


From  Eqs.  (3.8)  and  (3.  10),  the  variance  of  the  input  squared  values 

T  2 

a^2(t)  =  <f.^t))  -  <r^t))  =  2[<r^^t)  +  2  p^(t)<r/(t)]  (3.13) 
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Substitution  of  Eqs.  (3.10)  and  (3.11)  into  Eq.  (3.4)  yields 


Thus,  the  variance 

or  ^(t)  =  —  (rSt)  +  2o-  ^(t)  ^(t)  (3.  15) 

N  [  ^  ^ 

2 

Note  that  (t)  approaches  zero  as  N  becomes  large  so  the  estimate 
v(t)  is  a  consistent  estimate  of 

Case  1.  Signal-to-Noise  Power  Ratios 

2  2 

In  terms  of  signal  and  noise  variances,  or  (t)  and  a  (t),  Eqs.  (3.2)  and 

9  li 

(3.  14)  become 

fr  T2 

<r^^(t)  =  o-^^(t)  +  o-^^(t)  +  2  p^t)  [o-g^(t)  +  o-^^(t)j  (3.  17) 

J  J 

An  output  signal-to-noise  (power)  ratio  will  be  defined  by 

P  ^(1) 

P  (t)  =  -  (3.  18) 

°  2 

0-  ‘■(t) 

V 

It  follows  that 

P^(t)  =  NP.(t)  (3.19) 
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where  P^(t)  is  the  input  signal-to-noise  (power)  ratio  defined  by 


The  input  quantity  P^(t)  ■«:  1  whenever  |  p.  (t)/cr^(t)|  ^  «  1  +'\/T|,  The  output 
quantity  P^it)  is  directly  proportional  to  the  number  N  of  available 
records. 

Three  special  examples  of  Eqs,  (3.15)  through  (3.20)  will  now  be 
examined.  It  is  assumed  in  all  examples  that  a^^(t)  ^  0. 

Special  Examples  of  Case  1; 

(1)  p  (t)  =  0,  o-^^(t)  ^  0 

For  this  special  example,  results  are 

N  L  ®  . 

Po(t)  =  ;  Pi(t)  =  7  (3.21) 

Equation  (3.21 )  shows  that  Pq(0  is  a  function  here  only  of  N. 

(2)  p(t)  i  0,  o-^(t)  =  0 

For  this  situation 

Kv(t)  =  o-g^t)  +  p  ^(t) 

^  ^^3^1)+  2p^t)<r^^t) 

] 

(3.  22) 


Po(t)  = 


n[i  +  2(p(t)/a^(t)  j^+|p(t)/ag(t)j 
2[l  +  2(p(t)/a^(t)]^] 
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which  shows  that  P^lt)  here  is  a  function  of  N  and  the  dimensionless 
ratio  (M.(t)/(r^(t)). 

For  small  (M-Zo-g),  P^(t)  a.  (N/2) 
while  for  large  (  ^i  /tr^),  P^it)  -as{N/4)(fj.  /o'g)^- 

(3)  (t)  4  0,  a  ^(t)  4  0 

n 

Upon  dividing  Eq.  (3.17)  by  <r^{t),  one  obtains  the  general  result 


using  the  simplified  notation 

(t) 

ns  n  s 

{  p  /or  )  =  p(t)/(r  (t) 
s  s 


(3.  23) 


Equation  (3.23)  shows  that  P  (t)  is  a  function  of  N,  (cr  /o’  j  and  {  u /o’  ). 

o  n  8  s 

Note  that  Eq.  (3.23)  reduces  to  Eqs.  (3.21)  and  (3.22)  for  those  situations. 

Various  calculations  can  be  made  from  Eq.  (3.  23)  based  on  assumed 

values  for  N,  (o’  /cr  ),  and  (  p/o’  ).  These  are  left  as  exercises  when  needed, 
ns  s 

Example:  Assume  (P  /®’g)  =  10 

Then 


n[4  +  4(0-  /o’  )^  +  (a  /o’  )^] 
I _  ns  '  n  s'  J 

2  [3  +  4(0-  /o’  )^  +  (a  /o’ 

L  ns  ns  -* 


For  (O’  /o’  )  =  0,  p  =  -  N 
'ns'  03 


For  (O’  /o’  )  =  1,  P  N 

ns  o  16 


For  (a  /o’  )  =  2,  P  =.i^N 
ns  o  54 

For  (o’  /o’  )  =  5,  P  =  — — ■  ■  N 
'ns  o  i45(, 


Thus,  for  fixed  (  p/o’  )  and  fixed  (o’  /o’  ),  P  is  a  simple  linear  function  of 
*^8  n  s  o 


N  as  pictured  in  Figure  3.  1, 
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Case  1.  Confidence  Bands 

Fi'om  Eqs.  ( 3. 1  6)  and  (  3. 1  7)  one  can  obtain  confidence  bands  which  will 
indicate  how  closely  a  measured  mean  square  value  will  approximate  the 
true  mean  square  value  at  any  time.  This  is  accomplished  as  follows: 

For  an  arbitrary  distribution  associated  with  tlie  measurements 
[v(t)l,  from  the  Tchebycheff  Inequality,  for  any  constant  X. 


Prob 


v(t)  - 


(3  24) 


where  p  ^(t)  and  represent  the  true  mean  value  and  standard 

deviation  associated  with  Now,  consider  the  range  for  estimating 

p^(t)  from  v(t)  as  given  by 

|v(t)  -  P^(t)|  =  (3,  25) 
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Solving  for  v(t)  yields  the  two  extreme  range  values 


v(t)  =ij^(t)  o-^(t)  (3.26) 

Now  for  X.  =  3,  Eq.  (3,24)  shows  that  there  is  89%  confidence  that  v(t) 
lies  in  the  range  [|J.jt)  -  3  o-^(t),  jj^(t)  +  3o-^(t)j  , 

Equation  (3,26)  can  be  put  into  another  equivalent  form  by  using 
Eq.(3.18).  This  yields 

v(t)=u(t)i:\  ;  ;  ^  (3.27) 

Hence 

I  ±[\/V~p;TO]  (3.28) 

From  Eq.  (3,28) ,  one  can  state  at  any  desired  confidence  level  how  closely 
a  measured  mean  square  value  v(t)  will  approximate  the  true  mean 
square  value  H-^(t). 

For  example,  if  X.  =  3  and  P  (t)  =  25,  then  there  is  89%  confidence 

o 

that  lies  in  the  range  bounded  by 

(t)  =  - =  fo.  625v(t)  to  2.  5v(t)l 

v'  '  1  i  0.  60  I  J 

For  PQ(t)  =  100  and  X.  =  3,  the  89%  confidence  range  becomes 

H  (t)  =  — —  =  fo.  77  v(t)  to  I.  43  v(t)l 
I  i  0.30  ^  J 
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as  a 


Figure  3.2  basedonEq.  (3.  28)  is  a  plot  of  the  ratio  p.^(t)/v(t) 

function  of  P  (t).  Two  cases  are  considered.  Case  1  applies  to  arbi- 
o 

trary  distributions  for  v(t)  and  sets  K  =  3  corresponding  to  an  89% 
confidence  band  as  given  by  the  Tchebycheff  Inequality.  Case  2  applies 
to  a  Gaussian  probability  distribution  for  v(t)  and  sets  X.  =  2  corre¬ 
sponding  to  a  95%  Gaussian  confidence  band.  The  lower  and  upper 
limits  used  for  Figure  3.  2  are  shown  in  Table  3.  1. 


Case  1 

Case  2 

Po(t) 

- 1 

Lower 

Limit 

Upper 

Limit 

Lower 

Limit 

Upper 

Limit 

4 

.  •  • 

•  «  . 

oo 

9 

0.  50 

oo 

3.  00 

16 

0.  57 

4.  00 

0.  67 

2.  00 

25 

0.  63 

2.  50 

0.  71 

1.  67 

36 

0.  67 

2.  00 

Km 

L  50 

64 

0.  73 

1.  60 

L  33 

100 

0.  77 

1.  43 

0.  83 

1.  25 

144 

0.  80 

1.  33 

0.  86 

1.  20 

225 

0.  83 

1.  25 

0.  88 

1.  15 

324 

0.  86 

I.  20 

0.  90 

1.  12 

400 

0.  87 

1.  18 

0.  91 

1.  1 1 

Table  3. 1  Data  for  Figure  3.  2 
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Figure  3.  2  Confidence  Bands  for  (t)/v(t)  as  function  of  P  (t) 
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Case  2.  Dependent,  Samples 

This  case  differs  from  Case  1  in  that  Eq.  (3.  7)  where  i  ^  j  is 


replaced  by 

<f^(t)f.(t))  =  (s.^(t))= 

It  follows  that  Eq.  (3.  11)  where  i  ^  j  is  then  replaced  by 

(fi^t)f,^t))  =[^/(t)+  p^(t)]  +2[(r^(t)+  2p^(t)a^V)]  (3-30) 

Substitution  of  Eqs.  (3.  10)  and  (3.  30)  into  Eq.  (3.  4)  now  yields 
all  that  was  obtained  before  in  Eq.  (3.  14)  plus  an  additional  term,  namely, 

<v^t))  =  (<v(t)))^  +  I  <T^(t)  +  2  p^t)<r/(t)  +  ^t)  +  2  p^(t)(r  ^(t) 

\  /  L  J  L  s  s  j 

(3.  31) 

It  then  follows  from  Eqs.  (3.  3)  and  (3.  8),  that  the  variance 

‘r/(t)  =  2c-^^t)  a^{t)  +  2p^t)  +  |  cr^^(t)  cr^^t)  +  2  p^(t) 

(3.  32) 

Equation  (3.  32)  should  be  compared  with  Eq.  (3.  17)  from  Case  1.  Note 
2  2 

that  if  cr^  (t)  4  0,  then  cr^  (t)  no  longer  approaches  zero  as  N  becomes 
large  so  that  in  Case  2  the  estimate  v(t)  is  not  a  consistent  estimate. 

As  in  Case  1,  an  output  signal-to-noise  (power)  ratio  will 

be  defined  by 

^(t) 

Po(t)  =  — -  <3-33) 

0-  It) 

V 

For  Case  2,  given  by  Eq.  (3.  16)  and  o'^^(t)  by  Eq.  (3.  32). 
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Two  special  examples  of  Eqs.  (3.32)  and  (3.33)  will  be  examined. 
Special  Examples  of  Case  2; 

( 1)  p.(t)  =  0,  <J'^(t)  i  0 

2  2 

For  this  example  ^(t)  =  ^{t)  + 

2  4  24  2r4  4 

0-  It)  =  2(r  It)  +  -  0-  It)  =  -  No-  ^(t)  +  (T  (t) 
v''  s''  iqn''  jq  s''  n'' 

Hence 

n[i  +  2{cr  /cr  )^  +  (cr  /o’  )^1 
,  L  ns  ns 

P^(t)  =  - i  (3.34) 

2  N  +  (cr  /a  ) 

L  n  s  J 

Thus,  P  (t)  IS  a  function  here  of  both  N  and  (cr  /a  ), 
o  ns 

For  small  (<t  I<t  ),  P  lt)<^0.50 
ns  o 

while  for  large  (c  /<t  ),  P  (t)«(N/2). 

ns  o 

(2)  p(t)  i  0,  cr^^(t)  =  0 

For  this  example,  arid 

crj(t)  =  2<r^^t)[<7^^t)  +  2  p^t)] 

Hence 

1  +  2(  P  /o-g)^  +  (  P 

P3{t)  =  - 2 -  (3.35) 

2  +  4(^/0-^) 

For  small  (  p/cr  ),  P  (t)«0.50 
s  o 

2 

while  for  large  (  p  /cr  ),  P  (t)«0,  25  (  p  /a  ) 

SO  s 
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Case  3.  Correlated  Samples 

For  this  case,  it  will  be  assumed  that 

<^f^(t)f.(t))  =  <^s^(t)  Sj(t)^=  Rg^(k,  t)  where  k  =  j-i  (3.36) 

The  quantity  R^^(k,  t)  was  defined  previously  in  Eq.  (Z,  42)  dealing  with 
the  measurement  of  average  response  values  for  correlated  data.  Equa¬ 
tion  (3.  11)  where  i  /  j  is  now  replaced  by 


<f.^t)f.^(t))  =[o-^^(t)+  p^t)]^+  2[Rj(k,t)  -  p^t)]  (3.37) 


When  i'=  j,  Eq.  (3.  36)  reduces  to 


(^1^(1))=  (si^(t))=  R^s(°’ ^  l^^(t)  (3.38) 

From  Eqs.  (3,37)  and  (3.38),  Case  1  and  Case  2  are  thus  seen  to  be  special 
cases  of  Case  3,  namely, 

(1)  Rgg(^-  0  =  P^(t)  for  all  k  =»  1  yields  Case  1 

(2)  R  (k,  t)  =  R  (0,t)  for  all  k  =*  I  yields  Case  2 

s  s  s  s 

A  procedure  for  handling  Rgg(^'  was  developed  in  the  previous 
material  on  average  response  computers.  A  similar  analysis  carried 


out  here  yields  the  result 


‘'v(t)  "  ^  +  <r/{t)  p^(t)  +-^  ^  (N-k)  Rfg(k,t)  -  p^t) 


-  K  (t)  (3.39) 


Equation  (3,39)  is  a  major  result  of  this  investigation.  It  includes 

Eqs.  (3.17)  and(3,32)  as  special  cases.  As  discussedpreviously  R  (k,  t)  can 

s  s 

be  interpreted  as  a  measure  of  adaptive  changes  in  records  occurring  from 

repeated  stimuli.  Thus,  R  (k,  t)  may  be  useful  for  analyzing  such  items 

s  s 

as  structural  fatigue  effects,  or  learning  patterns  in  physiological  systems. 
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Exponential  Correlation  Function 


In  order  to  obtain  some  quantitative  expressions  corresponding  to 

Eq.( 3.  39)  which  will  characterize  different  degrees  of  correlation,  assume 

that  R  (k,  t)  has  the  exponential  form 
s 

R  (k.t)  =  p^{t)  +  (3.40) 

where  k  and  c  are  positive  constants.  The  parameter  c,  called  the 
correlation  coefficient,  is  such  that  a  large  value  of  c  corresponds  to 
Case  1  while  a  small  value  for  c  yields  Case  2.  Thus  the  value  of  c 
may  be  used  to  compare  different  physical  situations. 

The  sum  in  Eq. (3. 39)  may  be  evaluated  as  follows: 


Let 


Then 


N-1 


1 


-(N-l)c 

e 


(3.41) 


F(c)  =  >  (N-k)  e"^^  =  Nf(c)  +  f'(c)  = 


(N-  1)6*^  - 


(3.42) 


From  Eq.  (3.40),  the  term 


H^t)=a^^t)  2»x^t)e’^''  +  a^^t)e'^*"'' 


(3.  43) 


Hence 

N-1 


-57  (N-k) 

N  fel 


RL(k.t)-  ^,\t) 


A  2,.,  NiL_1 

4o-^(t) 


ss 


1  4«r^(t)^ 


(N-k) 


,  2...  -kc  ^  2,  .  -2kc 

2  ^  (t)  e  +  <r  (t)  e 


N* 


2  p^t)F(c)  +  <rg^t)F(2c)  (3.44) 


where  F(c)  is  given  by  Eq.  (3.42). 
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Equation  (3.  44)  can  be  used  to  generate  a  set  of  curves  for  different 
values  of  N  and  c.  For  a  given  value  of  N,  and  for  known  values  of 
(JL  (t)  and  tr^(t),  actual  experimental  results  would  enable  one  to  esti¬ 
mate  the  correlation  coefficient  c. 

3.  3  CONCLUSION 

This  material  on  mean  square  value  measurements,  together  with 
the  previous  material  in  Section  2  on  average  response  (mean  value) 
measurements,  provides  basic  formulas  for  analyzing  a  wide  class 
of  nonstationary  data  occurring  in  physical  problems.  For  given  input 
conditions,  one  can  decide  in  advance  how  large  the  sample  size 
(number  of  records)  should  be  to  guarantee  a  desired  confidence  in 
final  results.  Conversely,  for  a  given  sample  size  and  for  given 
input  conditions,  one  can  determine  confidence  bands  about  measured 
results. 

Various  special  techniques  are  developed  here  which  may  prove 
useful  also  for  other  problems.  In  particular,  the  mathematical 
model  which  has  been  considered  for  correlated  samples  offers  a  new 
procedure  for  analyzing  fatigue  effects  or  other  adaptive  physical 
changes. 
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4.  SPECTRAL  DECOMPOSITION  OF  NONSTATIONARY  PROCESSES 

4.  1  POWER  SPECTRAL  DENSITY  FUNCTIONS  FOR  STATIONARY 
PROCESSES 

For  a  single  stationary  record  x{t),  the  power  spectral  density 
function  defines  the  rate  of  change  of  the  mean  square  value  of  the 
record  with  frequency.  The  mean  square  value  inside  any  frequency  band 
IS  found  by  merely  summing  the  power  spectral  density  function  across 
the  band.  In  equation  form,  if  S^(f)  is  the  stationary  two-sided  power 
spectral  density  function  of  x(t),  defined  over  (-oo,  oo),  then  the  mean 
square  values  x^(f^,f2)  inside  given  by 


where  the  factor  2  is  due  to  the  two-sided  nature  of  S^(f). 

The  same  formula  describes  the  average  power  inside 
a  stationary  random  process  ^x(t)  j  by  interpreting  S^{f)  as  the  ensemble 
average  of  all  the  individual  stationary  power  spectral  density  functions 
in  the  random  process. 

One  should  note  that  the  result  of  Eq.  (4.  1)  is  independent  of  t 


since  the  random  process  is  assumed  to  be  stationary.  For  a  stationary 
process,  one  can  prove  that  S  (f)  is  the  Fourier  transform  of  the 
stationary  autocorrelation  function  R^(t),  namely, 


S  (f)  = 

X 


R  (t)  e  dr 


(4.  2) 


where  is  defined  by  the  ensemble  average 


R^(t)  =  ^(t)x(t  +  t)^  ,  independent  of  t 


(4.  3) 
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yields 


In  terms  of  S^(f)>  the  inverse  Fourier  transform  to  Eq.  (4.  2) 

R^(t)  =  /  df 

■J-co 

The  total  mean  square  value  is  independent  of  t  and  is  given  by 


(4.4) 


^OO  r-co 

R^(0)  =  <x^(t))  =  I  S^(f)df  =  2/  S^(f) 

■J-CO  -Jq 


df 


(4.5) 


When  a  random  process  is  nonstationary ,  the  nonstationary  auto¬ 
correlation  function  is  no  longer  a  function  of  a  single  time  variable 
but  instead  is  a  function  of  two  time  variables.  The  corresponding 
nonstationary  power  spectral  density  is  also  no  longer  a  function  of  a 
single  frequency  variable  but  instead  is  a  function  of  two  frequency 
variables.  By  proper  definitions  and  interpretation,  one  can  show  that 
nonstationary  autocorrelation  functions  and  corresponding  nonstationary 
power  spectral  density  functions  are  double  Fourier  transforms  of  one 
another,  which  reduce  to  the  above  formulas  in  the  stationary  case.  A 
similar  correspondance  exists  for  nonstationary  cross-power  spectral 
density  functions  and  nonstationary  cross-correlation  functions.  This 
procedure  will  now  be  carried  out,  and  appropriate  expressions  will  be 
derived  which  describe  general  nonstationary  processes. 

A  separate  section  will  consider  special  situa,tions  of  nonstationary 
random  processes  which  are  locally  stationary.  These  represent  impor¬ 
tant  physical  cases,  such  as  turbulence,  where  the  average  instantaneous 
power  may  vary  slowly  with  respect  to  the  correlation  time. 
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4.  2  CORRELATION  (COVARIANCE)  STRUCTURE 

OF  NONSTATIONARY  PROCESSES 

For  general  real-valued  nonstationary  random  processes,  ^^x{t)j  , 
[^y(t)}>  the  mean  values  at  arbitrary  fixed  values  of  time  t  are  defined 
by  the  ensemble  averages 


N 

II 

(  ^x(t)  V  .  = 

\  '  '  /  Av  over  k 

lim 

N-*oo 

1 

N 

L 

^x(t) 

;  t  fixed 

N 

y(‘)  =< 

\  ^  Av  over  k 

lim 

N->oo 

1 

N 

L 

S(t) 

;  t  fixed 

The  record  index  k  is  averaged  out  in  computing  these  ensemble  averages 
which  are  indicated  by  angular  brackets  For  simplicity  in  notation,  the 
index  k  will  be  omitted  in  future  equations.  However,  t  must  be  retained 
since,  in  general,  these  mean  values  will  change  with  time. 

The  covariance  functions  at  arbitrary  fixed  values  of  tj  and  t^  are 
defined  by  the  ensemble  averages 


(4-7) 


For  stationary  random  processes,  these  results  would  be  a  function  of  the 

difference  (t^  -  t^)  or  (t^  -  t^)  rather  than  tj  or  t^.  In  general,  however, 

these  quantities  will  vary  with  both  tj  and  At  the  special  point 

t  =  t,  =  t^,  the  covariance  functions  p  (t,  t)  and  p  (t,  t)  represent  the 
1  2  "^x  "^y 

ordinary  variances  of  and  ^y(^)j  at  a  fixed  value  of  t,  while 

represents  the  cross-covariance  between  |^x(t)j  and  |^y(oj  • 
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The  correlation  functions  for  nonstationary  processes  are  defined 


t^)  =  <(x(tj)x(t2)) 

RyVtj.t^)  =  <(y(tj)y(t2)>  (4.8) 

^xy^4’4>  =  <K(tj)y(t2)) 


where  R  is  introduced  instead  of  p  to  agree  with  engineering  usage. 

Note  that  for  zero  mean  values,  the  correlation  functions  are  the  same  as 
the  covariance  functions.  The  quantities  non¬ 
stationary  autocorr^laitioii  functions,  while  Rxy^^l’^2^  ^  nonstationary 

cross-correlation  function.  The  cross-correlation  function  R  includes 


-  xy 

the  autocorrelation  function  as  a  special  case  when  x  =  y. 

For  arbitrary  values  of  p  (t)  and  p  (t)  the  covariance  functions 

X  y 

and  correlation  functions  are  related  by 


'’x“r‘2>  =  V‘r'2>  ■ 

Py(‘l’'2’  = 

Pxy<'r‘2»  =  V<‘|’‘2>  ■  ‘‘x'‘l>V'2> 


An  upper  bound  for  the  cross-correlation  (or  autocorrelation) 
function  is  given  by  the  inequality 


Ir  (t,, 

xy  1 


,)|^=  R^(t^,tj)Ry(t2.t2) 


(4.  10) 


From  the  original  definitions,  one  sees  that  the  following  symmetry 
properties  are  satisfied. 


V2-'l)  =  Vl''2> 


R 

xy 


(t 


2' 


‘l>  = 


R  (t,, 

yx  1 


^2^ 


(4.  11) 
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The  correlation  structure  of  nonstationary  random  processes  |^x(t)j  , 

l^y(t)  j  may  be  described  by  the  four  functions  ^2)- 

R  (t,  ,  t-,)  and  R  (t,  ,  t,).  These  need  be  calculated  only  for  values  of 
xy  1  Z  yx  1  Z 

t  j  i  t^  since  the  symmetry  properties  of  Eq  (4.11)  yield  results  for  t^^tj. 

When  the  mean  values  are  zero,  for  arbitrary  t,  R^(t,  t)  and  R^(t,  t) 

represent  the  variance  associated  with  fx(t)j  and  |^y(t)  i  ,  respectively, 

presents  the  cross -covariance  between  fx(t)i  and  fy{t)l 

1.  j  L  j 

Consider  the  problem  of  measuring  definition 

Rx(ti.  t^)  =  (x(t^)  x(t2)) 


while  R  (t,  t)  re 
xy 


Theoretically,  all  possible  combinations  of  the  two  times  tj  and  t^ 
should  be  used  in  computing  ^  tremendous  task.  To  lighten 

this  work,  a  special  cross-section  can  be  studied. 

A  recommended  procedure  is  as  follows.  Hold  t^  fixed  and  vary 
t2'  Let  ^2  “  ^  T  =  0.  This  yields 

^x^S'  "  (x(tj)x(tj  +  t)) 


For  fixed  t^,  this  result  is  a  function  only  of  t.  By  varying  t^  in  small 
steps,  the  dependence  on  t^  will  be  exhibited.  For  stationary  random 
processes,  there  would  be  no  dependence  on  tj.  Clearly,  if  tj  +  t) 

is  determined  for  all  possible  t^  and  all  possible  xiO,  then  one  should 
be  able  to  state  the  general  form  of 

Example :  Suppose  R^(t^,  t^  +  x)  =  cos  f2x  +  cos  n(2  t ^  +  x).  By  letting 

X  =  ^2  ■  one  finds  from  a  trigonometric  identity, 

R  (tot,)  =  Zcos  nt,  cos  f2t, 

X  1  Z  1  Z 
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4.  3  SPECTRAL  DECOMPOSITION  OF  NONSTATIONARY  PROCESSES 


To  obtain  a  spectral  decomposition  for  a  pair  of  random  processes 
x(t)  and  |^y(t)j,  it  will  now  be  assumed  that  each  particular  member  of 
either  random  processes  has  a  complex  Fourier  transform 


X(f)  =  /  x{t)e‘-’^’'^^  dt 


(4.  12) 


Y(f)  =  /  y(t)e‘-’^’'^^  dt 


The  parameter  f  denotes  the  frequency  (usually  cps)  while  j  ='V  - 1  • 


Inverse  Fourier  transforms  yield 


x(t)  =  X(f)e-’^’'^’^  df 


y(t)  =  Y(f)ej^'^^^  df 


(4.  13) 


Thus,  an  original  pair  of  real-valued  nonstationary  random  processes 
[x{t)]  ,  fy(t)]  may  be  described  in  terms  of  two  new  complex-valued 
random  pro  cesses  |^X(f)|,  [Y(f)J  . 

When  x(t)  is  real-valued,  it  follows  that  the  complex  conjugate 


X(f)  is  given  by 


X(f)  = 


x(t)ej^^^‘  dt  =  X(-f) 


(4.  14) 


Also,  since  x(t)  is  real-valued. 


x(t)  =  I  X(f)e‘j^^^‘  df 


(4.  15) 
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Consider  now  the  nonstationary  correlation  function  R^(tji 
From  Eqs.(4.  13)  and  (4.  15),  one  finds 


-oo 


_ -j2iTf,t. 

x(tj)x(t2)  =  /  X(fj)e  df 


■00 


.oo 

-00 


df. 


using  a  variable  f^  instead  of  f ^  in  the  second  integral  to  avoid  confusion. 
The  ensemble  average  yields 


=  <[x(tj)x(t2))  = 


oo 


oo  -oo 


-j2n(f,t  -f  t  ) 

Jfj,f2)e  ^  dfjdf 


where 


S^(£,,f2)=<X(f,)X(f2)> 


2 

(4.  16) 
(4.  17) 


By  inversion, 


00 


-oo  -^00 


j2ir(f jtj  f^t^) 


dtidt2 


(4.  18) 


The  quantity  called  the  generalized  (nonstationary)  power 

spectral  density  function  of  the  random  process  |^x{t)j. 

For  general  cases,  from  Eq.  (4.  16), the  variance 


df  j  df^ 


/  ^  \  /  1  j2Trt(f2-fj) 

R^(t,t)  =<x^(t))  =  '  '  — 

(4.19) 

Similarly,  one  derives  for  the  nonstationary  cross-correlation  function 


R  (t,,t,)= 

xy  1  2 


and 


S  (f,.f,)e 
xy  1  2 


-j2Tr(f  jtj-f2t2) 


dfidf2 


S  (f 
xy' 


rr 

-'-00  -^-00 


R  (t.,t,)e 
xy  I  2' 


(4.  20) 


dtfdt^ 
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where 


(4.21) 


The  quantity  S  (£.,£,)  is  called  the  generalized  (nonstationary)  cross- 
xy  1 


power  spectral  density  £unction  between  the  pair  o£  processes  |^x(t) 
^y(t)|.  One  should  note  the  basic  symmetry  between 
®xy^^r^2^  as  exhibited  by  Eq.(4.  20). 

From  Eqs.  (4.  14),  (4.  17),  and  (4.  21), 


and 


S  (£,,£,)  =  S  (£,,£,)  =  S  (-£,.-f,) 
xy  1  2  yx  2  1'  xy  1  2 


(4.  22) 


For  the  special  point  t  =  tj  =  t^,  Eq.(4.  20)  becomes 


-00  -'-oo 


00 


S  (£..£,)  e 
xy  1  2' 


j2iTt(£2-£j) 


d£j  d£2 


(4.  23) 


Note  that,  £or  nonstationary  random  processes,  the  dependence  on  t  is 
shown  in  the  exponent  in  Eq.(4.  23). 


4.  3.  1  Stationary  Random  Processes 

For  stationary  random  processes,  Eq.  (4.  23)  would  be  independent 


o£  t,  namely. 


R  (t,t)  =  R  (0,0)  =  , 
xy  xy  ;  /  xy 

-oo  ^-oo 


(4.  24) 


It  £ollows  that,  £or  stationary  random  processes. 


-oo 


xy- 


(4.  25) 


-oo 
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where 


■  CD 


S  (f,)  =  /  S  (f,.f  Jdf. 
XV  2'  I  xy  1  2'  1 

Hence,  for  stationary  random  processes, 


(4.  26) 


where  6(f2  -  fj)  is  the  usual  Dirac  delta  function  at  =  f^'  In  geometri¬ 
cal  terms,  concentrated  only  on  the  line 

(£^,£2)  plane.  Note  also  that  ^2  ^  ^I'  delta  function 

is  an  even  function,  so  that  one  can  replace  6(f)  by  6(-f)  whenever  desired. 

Conversely,  suppose  that  a  generalized  cross-power  spectral 
density  function  has  the  form 


S  {£,.£,)  =  S  (f,)6(f-  -  f.) 
xy  I  2'  xy  1  2  r 


xy 


(4.  28) 


One  can  derive  from  Eq.(4.  20),  letting  “  ^2  '  ^1 


-00 


R  (t.,t,)  =  R  (t, -t.)  =  R  (t)  =  /  S  (f)e“’^’^^^df  (4.29) 

xy  12'  xy  2  I  xy  /  xy  '  ' 


■00 


where 


S  (f) 
xy 


R  (T)e-j^'f^dT 

xy 


(4.  30) 


Thus  the  cross -correlation  function 
IS  stationary. 


R  (t,,t;,) 
xy  1  2' 


corresponding  to  Eq.(4.  28), 
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4.  3.  2  Nonstationary  Random  Processes 


Return  now  to  the  consideration  of  general  nonstationary  processes. 
Through  a  change  in  variables,  let 


Then 


t  = 


Thus,  through  the  above  change. 


(4.31) 


(4.  32) 


Vl’‘2)  =  V-f  '  + 


The  reason  for  introducing  this  transformation  from  the  (tj,  t^)  plane 

to  the  (t,  t)  plane  is  to  separate,  if  possible,  the  nonstationary  portion 

of  the  process  from  the  stationary  portion  of  the  process.  For 

stationary  processes,  there  would  be  no  dependence  upon  t.  Note  that 

R  {t,t)=,?f  (t,  0). 

xy  ‘xy 

From  Eqs.  (4.  11)  and  (4.  33)one  obtains 


/f’x(t.  -t)  t) 

/f  (t,  -t)  (t,  t) 

xy  yx 


(4.  34) 


Substitution  of  Eq.(4.  32)  into  Eqs.  (4.  19)  or  (4. 20)yields  (omitting  the  sub¬ 
scripts  X  or  xy) 


S(f 


noo 

/lit. 


-OO  '-00 


-J 


(fj  -  f,). 


t)  exp  i 


-j  2tt 


(f2-fl)t  + 


'^1  +  ^2^ 


)dt  dr 


f.  g)  =  S(g  '  g  +  |  )  (4.  35) 
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through  a  change  in  variables  where 


f  = 


^  =  g-4 


g  = 


h 


(4.  36) 


4  =  g+T 


Thus  S(fj.f2)  in  the  (11^2)  pl^ne  is  transformed  to  «(£,  g)  in  the  (f,  g) 
plane,  and 


By  inversion, 


a  00 

» 

a  00 

(4. 

Ti 


37) 


38) 


This  transformation  to  J(f  ,  g)  is  required  in  order  to  bring  out 
intrinsic  frequency  properties  of  the  transformed  nonstationary  corre¬ 
lation  function  ^(t,  t).  It  will  be  shown  shortly  that  for  a  stationary 
random  process  j^(f,  g)  must  be  zero  everywhere  in  the  (f,  g)  plane 
except  along  the  line  f  =  0. 

Corresponding  to  Eq.  (4.  19),  the  variance 

-00  ^00 

J  (f.g)ej^’^^‘df  dg 


/f'^(t,0)  =<x^(t))  = 


•'-00  -^-ao 


Note  also  that 


=  <'x(-t/2)x(t/2))  = 


00 


00  •'-00 


df  dg 
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4.  3.  3  Separable  Case 

Assume  that  the  nonstationary  correlation  function^(t,  x)  can  be 
separated  into  the  products 


t.r)  =  Rj(t)R2(T)  =  Rjl 


4  ^  '2' 


R2(t2  -  tj)  (4.39) 


where  R.2^^^  “  ~  ^1^  ^  stationary  correlation  function,  and 

R^(t)  =  Rj  ^(tj  +  t2)/2j  is  a  variable  scale  factor  defined  at  the  midpoint 
(average)  of  the  points  t^  and  t2-  For  stationary  random  processes, 
Rj(t)  is  a  constant. 

The  process  is  said  to  be  locally  stationary,  see  Ref.  j^zj,  if  Rj(t) 
is  a  non-negative  function  of  t.  Although,  in  general,  Rj(t)  is  an 
arbitrary  function  of  t,  it  may  be  possible  to  break  up  a  random  process 
into  a  number  of  smaller  samples  such  that  these  smaller  samples  are 
stationary  or  locally  stationary.  For  example,  a  physical  process  (such 
as  turbulence  phenomena)  is  locally  stationary  if  its  average  instantaneous 
power  is  varying  slowly  with  respect  to  its  memory  (correlation)  time. 

Substitution  of  Eq.(4.  39)  into  Eq.  (4.  37)  yields 


nco 

Rj(t)R2(T)e'j^''^^^^®'"^  dt  dr 

30 


where 


=  Sj(f)S2(g) 


Sj(f)  =1  Rj(t)e'-’^''^‘  dt 


(4.  40) 


f  =  fz  -  fi 


(4.41) 


S2(g)  =/  R2(T)e’'^^’^®'^  dr  ;  g  = 


fi  +  fz 
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By  inversion 


oo 


Rjlt)  = 

R2(t)  = 


df 


'-00 
"OO 

y-oo 


S2(g)=J'’8T 


(4.  42) 


For  a  stationary  random  process  where  Rj(t)  is  a  constant,  say 
Rj(t)  =  c,  the  corresponding  Sj{f)  is  a  delta  function  given  by  Sj(f)  =  c6{f). 
Thus,  for  a  stationary  process, 


(t,  t)  =  c  R2('’') 

with  (4.43) 

J  (f,  g)  =  c6(f)  S2(g) 


In  words,  when  R{t,  t)  has  no  dependence  on  t  and  is  a  function  only  of 
the  time  difference  t  =  £2'^!’  spectral  density  function  g)  is 
concentrated  on  the  line  f  =  0  in  the  (f,  g)  plane. 

For  the  special  case  of  stationary  "white"  noise  where  R2('’’)  =  ^(t), 
a  delta  function,  the  corresponding  S2(s)  =  I.  a  constant.  Now, 

^(t,  t)  =  c  6{t) 

with  .  (4.  44) 

J-  ({,  g)  =  c6(f) 

Thus,  for  this  case,  and  this  case  alone,  the  spectral  density  function 
J{[,g)  is  itself  stationary  since  there  is  dependence  only  on  the  frequency 
difference  f  =  £2  "  Equation  (4.  43)  shows  that  for  general  stationary 
random  processes,  the  corresponding  spectral  density  function  is  not 
stationary  since  there  is  dependence  on  g  =  (f^  +  i^lZ. 
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4.3.4  Slowly  Varying  Nonstationary  Random  Processes 

Suppose  /((t,  r)  as  defined  by  Eq.  (4.  33)  varies  slowly  with  respect 

to  t.  Then  a  single  record,  or  a  pair  of  records,  can  be  broken  up  into 

a  number  of  shorter  records  such  that  /^(t,T)  is  essentially  independent 

of  t  over  the  shorter  records.  Define 


•CD 


■^(g.t)=  1  ^(t,  t)  dr 


(4.  45) 


-CD 


When^(t,  t)  is  independent  of  t,  thenj^{g,  t)  is  the  power  spectral  density 
function  of  a  stationary  random  process  whose  accuracy  can  be  estimated 
by  well  known  procedures. 

The  nonstationary  generalized  spectral  density  function  ^ (f,  g)  can 
now  be  determined  from  J (g,t)  by  taking  its  complex  Fourier  transform 
with  respect  to  t.  This  follows  from  Eq.  (4.  37)  by  noting  that 


^(f.g)  = 


oo 


'-00 


-oo 


'-oo 


-jZirft  , 
dr  e  •'  dt 


•oo 


^(g,  t)  e  dt 


(4.  46) 


•oo 


Further  discussion  of  this  idea  and  related  matters  concerning 
the  analysis  of  nonstationary  processes  appears  in  Ref.  ^  ij. 
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5.  INPUT -OUTPUT  RELATIONS  FOR  NONSTATIONARY  PROCESSES 


5.  1  INTRODUCTION 

The  subjects  covered  in  this  section  are  of  considerable  theoretical 
and  practical  importance  for  many  problems  of  predicting  output  effects  of 
nonstationary  random  processes  from  knowledge  of  input  properties  and 
system  characteristics.  For  other  problems,  the  input  conditions,  or  the 
system  behavior,  can  be  predicted  from  measurement  of  the  output  proper¬ 
ties.  Optimum  systems  can  also  be  derived  from  certain  input-output 
information  1 

In  the  present  discussion,  emphasis  will  be  placed  on  time-varying 
linear  systems,  and  methods  will  be  developed  for  describing  such  systems 
both  in  the  time  domain  and  the  frequency  domain.  Physical  situations  of 
constant  parameter  linear  systems  are  treated  as  a  special  subclass  of 
time-varying  linear  systems. 

After  reviewing  some  of  the  basic  properties  of  time-varying  linear 
systems,  linear,  integral,  and  derivative  transformations  of  random  func¬ 
tions  are  considered  in  a  general  way.  This  is  then  followed  by  the  main 
material  in  this  section  dealing  with  input-output  relations  of  nonstationary 
random  processes  through  time-varying  linear  systems. 

5.  2  TIME -VARYING  LINEAR  SYSTEMS 

A  time-varying  linear  system  is  characterized  by  a  weighting  function 
h(  a,  t)  which,  by  definition,  represents  the  response  of  the  system  at  time 
t  to  a  unit  impulse  function  applied  at  time  t  -  a  ,  that  is  a  time  units 
earlier.  If  the  system  response  is  independent  of  the  particular  time  t 
at  which  the  system  is  being  observed  and  is  a  function  only  of  a,  namely 
h(a,  t)  =  h(a),  then  the  system  is  said  to  be  a  constant  parameter  linear 
system.  Thus,  a  constant  parameter  linear  system  is  a  special  case  of  a 
time-varying  linear  system. 

In  order  for  a  time-varying  linear  system  to  be  physically  realizable, 
it  is  necessary  that  the  system  respond  only  to  past  inputs.  In  equation 
form,  this  implies 

h(a,  t)  =  0  for  a«0,  independent  of  t  (5.  1) 

Also,  since  there  should  be  no  response  to  inputs  occurring  in  the  infinite 
past, 

lim  h{a,  t)  =  0  (5.2) 

a— ►oo 
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If  x(t)  is  an  input  to  a  time-varying  linear  system  characterized 
by  h(a,  t),  and  if  y(t)  is  the  output,  then  the  output  is  given  by 


y(t) 


h(a,  t)  x(t  -  a)  da 


(5,  3) 


which  is  a  weighted  linear  sum  over  the  entire  past  history  of  the  input. 
For  a  physically  realizable  system,  the  effective  lower  limit  is  zero 
since  h(a,  t)  -  0  for  a*=0. 


x(t) 


Time -varying 
linear  system 

h(Q,  t) 


y(t) 


Instead  of  using  h(a,  t),  a  time-varying  linear  system  may  be 
characterized  by  a  time-varying  frequency  response  function  ^(f,  t) 
which  IS  defined  as  the  Fourier  transform  of  h(a,t),  namely. 


■  00 


?/(f,  t)  =  h(a,  t)e 


da 


-oo 


(5.4) 


For  a  physically  realizable  system,  the  effective  lower  limit  is  zero, 
This  quantity  ^(f,  t)  is  a  complex- valued  function  of  f  and  t  such  that 


;/(f.t)  =|^(f,t)jeJ^^^’^^  (5.5) 

where  the  absolute  value  |^f(t)|  measures  the  amplitude  response  of  the 
system  to  a  unit  sinusoidal  input  function  at  frequency  f,  while  9(f) 
measures  the  corresponding  phase  shift.  For  a  constant  parameter 
linear  system  ^(f,  t)  is  replaced  by  ^(f)  since  h(a,  t)  is  replaced  by 
h(a),  and  there  is  no  dependence  on  t. 
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5.  3  STABILITY  AND  REALIZABILITY 

The  system  h{a,  t)  is  said  to  be  stable  if  every  bounded  input  func 
tion  produces  a  bounded  output  function.  From  Eq.  (5.3), 


|y(t)l  = 


-OO 


h(a,  t)  x(t  -  a)  da 


'-0O 


•OO 


5  /  |h(Q,  t)||x{t  -  a)|  da 


'-00 


(5.6) 


When  the  input  x(t)  is  bounded,  there  exists  some  finite  constant  C 
such  that 

|x(t)j  2  C  for  all  t  (5.  7) 


Now, 


da 


(5.8) 


Hence,  if  the  time-varying  weighting  function 
integrable,  that  is,  if 


■OO 


h(a,  t)  da  «  oo 


■OO 


h(a,  t) 


is  absolutely 


(5.9) 


then  the  output  y(t)  will  be  bounded  and  the  system  will  be  stable.  Thus, 
Eq.  (5.9)  is  a  sufficient  condition  for  stability. 

The  condition  of  Eq.  (5.  9)  is  also  a  necessary  condition  for  stability. 
The  proof  of  this  statement  is  quite  simple  and  can  be  shown  as  follows: 
Suppose  Eq.  (5.9)  is  not  satisfied,  and  suppose  x(t)  is  a  bounded  input 
defined  by 

x(-t)  =  1  for  those  a  where  h(a,  0)2  0 
=  -  I  for  those  a  where  h(o,  0)  •*  0 

Now,  the  output 


y(0)  = 


h(a,  0)  x(-a)  da 


I  h(a,  0)|  da — ^ 


oo 


by  hypothesis,  and  the  system  is  not  stable. 
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when  considered  in  the  extended  complex  frequency  domain,  the 
condition  for  physical  realizability  of  a  time-varying  linear  system  takes 
an  interesting  form  Let 


H(s,  t)  = 


h{a,  t)  e 


sa 


da 


s  =  Y  +  j2irf 


(5.  10) 


By  definition,  the  frequency  response  function 


^{f,  t)  =  H(  s,  t)  when  y  =  (511) 

One  can  show.  Ref.  [2j,  that  h(a,  t)  will  vanish  for  q*=0,  (hence,  the 
system  is  physically  realizable)  if  the  domain  of  convergence  of  H(s,  t)  is 
at  least  a  half  plane  y*'0.  When  a  system  is  stable,  the  domain  of  con¬ 
vergence  H(s,t)  must  include  the  imaginary  axis  y  =  0.  Hence,  if  a 
system  is  both  stable  and  physically  realizable,  then  the  domain  of 
convergence  for  H(s,t)  is  at  least  the  entire  right-half  plane  yS*^- 

It  should  be  observed  that  stability  and  realizability  are  independent 
properties.  For  example,  a  system  defined  by  a  weighting  function 
h(a,  t)  =  e  IS  stable  for 


However,  since  h(a,  t)  is  not  required  to  vanish  for  a-^O,  this  system 
IS  not  physically  realizable  The  frequency  function  H(s,t)  for  this 
example  is  given  by 

H(s,t)=  /  e  ^'^^e  da  =  - - — -  if  |s|'-sl 

J  rr.  1  -  S 

-/-oo 

which  has  a  pole  in  the  right  half  plane  at  the  point  s  =  1,  and  hence  is 
not  realizable.  If  this  h(a,  t)  is  made  to  vanish  for  a'«:0,  then  H(s,t) 
becomes  l/(s+  I)  with  a  pole  in  the  left  half  plane  at  s  =  -1,  and  the 
system  is  now  realizable. 
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5.  4  BANDWIDTH  PROPERTIES  OF  CONSTANT  PARAMETER 
LINEAR  SYSTEMS 

Some  bandwidth  properties  of  constant  parameter  and  time-varying 
linear  systems,  as  developed  in  Ref.  [4^,  are  worthy  of  mention.  For  a 
constant  parameter  linear  system,  Eq.  (5.3)  becomes 


y(t)  = 


q)  da 


where  h{a)  =  0  for  acO  when  the  system  is  realizable.  When 
h{a)  =  6  (q),  a  delta  function, 


-oo 


x{t)  =  I  6(a)x(t  -  q)  da 


-oo 


The  nth  derivative  of  y(t)  with  respect  to  t  is 


(5.  12) 


(5.  13) 


(t) 


h(a)  x^”^(t 


a)  da 


Suppose  x(t)  is  sinusoidal  with  frequency  f.  Then 


x(t)  =  A  sin  (2irft  -I-  0) 

where  A  and  0  are  constants.  Now  the  second  derivative 

x^^^t)  =  -4ir^Af^x(t) 


(5.  14) 


(5.  15) 


(5.  16) 


It  follows  that 

=  -4ir^Af^y(t)  (5.  17) 

Thus,  y{t)  is  sinusoidal  also  with  the  same  frequency  f.  This  result 
shows  that  a  constant  parameter  linear  system  cannot  cause  any 
frequency  translation  but  can  only  modify  the  amplitude  and  phase  of  an 
input  signal.  In  particular,  there  can  be  no  bandwidth  increases  with 
such  systems. 
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BANDWIDTH  PROPERTIES  OF  TIME -VARYING  LINEAR  SYSTEMS 
For  time-varying  linear  systems,  Eq.  (5.  3)  states 


y(.t)  = 


h(a,  t)  x(t  -  a)  da 


(5.  18) 


where  h(a,  t)  =  0  for  acO  when  the  system  is  realizable.  If  an  input  x(t) 
is  sinusoidal  with  frequency  f,  it  no  longer  follows  that  the  output  y(t) 
will  be  sinusoidal  with  frequency  f.  The  factor  t  in  h(a,  t)  causes 
frequency  translation  to  occur  in  addition  to  amplitude  and  phase  changes. 

Suppose  h(a,  t)  is  periodic  in  t  with  frequency  F.  Then,  by  expand¬ 
ing  h(a,  t)  in  a  Fourier  Series, 


[q,  t)  =  hgCa)  + 


(5.  19) 


where  h  (a,  t)  is  sinusoidal  in  t  with  frequency  nF.  Now, 
n 


y(t)  =  yo(t)  +  7 


(5.  20) 


where 


y«(t)  =  j  h^(o)x(t  -  a)  do 


yn(t)  =  t)x(t  -  a)  da 


(5.  21) 


The  quantity  bQ(a)  represents  a  constant  parameter  linear  system  while 
h^(a,  t)  represents  a  time-varying  linear  system. 

A  general  form  for  b^(a,  t)  is 


h^(a,  t)  =  A^(a)  cos  ^2'irnFt  + 


(5.22) 
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Now, 


r 

n(0  =  I  cos^ZwFt  +  x(t  -  t)  do 

J-co 

(a)j  x(t  -  o) 

J-co 
rco 

/  A^(a)[8in  ^^(a)Jx(t  -  o) 

J-co 


=  cos  2vnFt 


do 


-  sin  2vnFt 


do 


(5.  23) 


For  each  sinusoidal  component  of  frequency  f  in  the  input  signal  x(t), 
say,  x(t)  =  sin  Zirft,  one  can  now  verify  that  the  output  y^(0  will  have 
sinusoidal  components  of  frequencies  nF  +  f  and  |  nF  -  f  |  .  This 
follows  from  the  trigonometric  expression 


A(a)  cos  2TFt  sin  2xf(t  -  a)  -  B{a)  sin  2vnFt  sin  2vf(t  -  o) 
=  2trfa  ^sin  2ir(nF  +  f)t  -  sin  2*(nF  -  f)tj 

-  sin  27rfa[cos  2ir(nF  +  f)t  +  cos  2ir(nF  -  f)tj 

-  cos  2iTfafcos  2x(nF  -  f)t  -  cos  2's(nF  +  f)t] 

2  *■ 

+  sin  2vfarsin  2x(nF  +  f)t  +  sin  2ir(nF  -  f)t] 

2  '• 


(5.  24) 


Thus,  a  time -varying  linear  system  produces  in  the  output  y(t)  a  higher 
bandwidth  than  the  bandwidth  of  x(t).  This  result  provides  a  theoretical 
explanation  for  some  situations  where  an  output  noise  bandwidth  is 
greater  than  the  input  noise  bandwidth. 
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5.  6  LINEAR  TRANSFORMATIONS  OF  RANDOM  FUNCTIONS 

An  operator  A  is  said  to  be  linear  if  for  any  set  of  admissable 

functions  x, ,  x^,  .  .  .  ,  x  and  constants  a. ,  a,,  .  .  .  ,  a  ,  it  follows  that 
1  2  n  1  2  n 

A(a^x^  +  +  .  .  .  +  a^x^)  =  ajA(xj)  +  a2A(x2)  +  .  .  •  +  a^A(x^)  (5.  25) 

The  operator  A  can  take  many  different  forms.  For  a  given  value  of  x, 
it  can  determine  a  function  y(x).  For  a  given  function  x(t),  it  can 
determine  a  function  y(t)  as  the  result  of  carrying  out  a  certain  opera¬ 
tion,  e.  g.  ,  differentiation.  The  process  of  integrating  x(t)  between 
definite  limits  generates  a  quantity  which  depends  on  the  given  function 
x(t)  and  on  the  integration  limits. 

An  arbitrary  linear  transformation  A^.  of  a  random  quantity  x(t) 
may  be  represented  symbolically  by 

y(z)  =  Aj.x(t)  (5.26) 

where  the  argument  z  may  or  may  not  be  the  same  as  t.  In  the  case 
of  differentiation  z  =  t,  while  in  the  case  of  a  definite  integral  z 
would  be  different  from  t. 

For  any  linear  operation,  the  process  of  averaging  of  the  data 
(taking  expected  values)  is  commutative  with  the  linear  operation, 
namely, 

E[y(z)]  =  E  [A^x(t)]  =  A^E[x(t)]  (5.  27) 

where  E  denotes  the  expected  value.  This  property  will  now  be 
applied  to  moments  of  y(z)  at  different  z. 

The  first  moment  of  y(z)  at  z  =  z^  is  defined  by 

li[(zj)  =  E[y(Zj)]  (5.28) 

which  is  the  ensemble  average  of  the  process  ^y{z)^  at  z  =  Zj.  From 
Eq.  (5.  27),  if  tj  corresponds  to  Zj  , 

Hy(Zj)  =  Aj^  p*(tj)  (5.29) 

where  ji*(tj)  =  E  [x(t j)  j  . 
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The  second  moment  is  defined  by  the  ensemble  average  of  the 
squared  values  of  y(z)  at  z  =  z^,  namely, 


fj.  J(zj)  =  E[y^(Zj)] 

From  Eqs.  (5.  26)  and  (5.  27), 

fxj(zi)  =  e[a^^^  x^tj)]  =  Af^ 

The  mixed  second  moment  is  defined  by  the  ensemble  average 

If  tj  and  t^  correspond  to  z^  and  z^.  then  Eq.  (5.  27)  yields 


P2(Zi>  *2^  =  ^t^  '^2^‘^r 


(5.  30) 


(5.  31) 


(5.  32) 


where  fj.  ^^tjj  12)  =  E^x(t^ ) x(t2)]  This  result  can  be  extended  to  prove 
that  n-fold  moments  of  the  image  of  x(t)  under  a  linear  transformation 
Aj  equals  the  n-fold  iteration  of  A^,  applied  to  the  n-fold  moment  of 
x(t).  In  equation  form  , 

p  ^(Zl,  Z2,  .  .  .  .  Zn)  =  At  At  .  .  At 

12  n 


where 


n  ^2 . =  E[y{Zj)  y(z2)  •  -  •  y(z^)  ] 


(5.34) 


These  results  will  now  be  applied  to  arbitrary  linear  integral 
transformations  of  random  functions.  Time  varying  and  constant 
parameter  linear  systems  are  merely  special  examples  of  such  integral 
transformations. 
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5,  7  INTEGRAL  TRANSFORMATIONS  OF  RANDOM  FUNCTIONS 
An  integral  transformation  of  any  particular  random  function 
x(t)  from  an  arbitrary  random  process  x(t)  is  defined  by 


F  = 


x(t)  (^(t)  dt 


(5.  35) 


where  ^(t)  is  an  arbitrary  given  function  for  which  the  integral  exists. 
For  any  given  ^(t)  and  limits  (a,  b),  the  quantity  Fisa  random 
variable  which  depends  on  the  particular  random  function  x(t). 

In  order  to  investigate  statistical  properties  of  the  random  variable 
F,  it  IS  customary  to  break  up  the  integration  interval  (a,  b)  into  sub¬ 
intervals  At  and  consider  the  approximation  linear  sum 


x(i  At)  <p(i  At)  At 


(5.  36) 


In  general,  the  probability  distribution  followed  by  a  sum  of 
terms  does  not  equal  the  probability  distribution  of  the  individual  terms. 
If  x(t)  follows  a  normal  distribution,  however,  one  can  show  that  F 
will  then  be  normally  distributed.  As  a  consequence  of  the  central 
limit  theorem,  the  random  variable  F  will  approximate  a  normal 
distribution  if  x(t)  is  such  that  values  arbitrarily  near  in  time  are 
mutually  independent  statistically.  One  can  prove  also  that  if  F  is 
considered  as  a  superposition  of  a  large  number  of  small  effects, 
none  of  which  contributes  significantly  to  the  sum,  then  F  will  approxi¬ 
mate  a  normal  distribution  for  arbitrary  x(t). 

Consider  now  the  transformation  of  moments  of  x(t)  due  to  the 
linear  integral  operation.  Since  the  average  of  a  sum  equals  the  sum 
of  the  averages,  from  Eq.  (5.  36),  the  first  moment 


p.  ^  (i  At)  0  (i  At)  At 


(5.  37) 


On  passing  to  an  integral,  one  obtains 


F 


Htf0(t)  dt 


(5.  38) 
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This  result;  can  also  be  obtained  directly  from  applying  Eq.  (5.  29)  to 
Eq.  (5.  35). 

Similarly,  by  considering  finite  sums  and  passing  to  integral 
form,  or  directly  from  Eq.  (5,  32)  applied  to  Eq.  (5.  35),  one  derives  for 
the  second  moment 


Eq.  (5.  39)  shows  that  the  second  moment  of  F  requires  knowledge  of 
the  mixed  second  moment  of  x(t).  Extensions  of  Eq.  (5.  39)  to  higher 
order  moments  of  F  of  order  n  requires  an  n-fold  integration  of 
mixed  nth  order  moments  of  x(t).  For  example, 

t^,  dtj  dt^dt^ 


5.  8  DERIVATIVE  TRANSFORMATIONS  OF  RANDOM  FUNCTIONS 
The  derivative  of  a  random  function  x(t)  from  an  arbitrary 
random  process  x(t)  is  defined  by  the  linear  operation 


lim 

At-^0 


X (t  +  At)  -  x(t) 
At 


=  x'(t) 


(5.40) 


when  this  limit  exists.  Conditions  for  the  existence  of  this  limit  will 
be  found  shortly.  For  any  given  x(t)>  the  derivative  x’(t)  is  a  random 
variable  which  depends  on  x(t). 

Consider  the  general  class  of  problems  where  |^x(t)J  follows  a 
normal  distribution  with  zero  mean  value  for  any  t.  Assume  that  there 
is  a  statistical  dependence  between  values  of  |^x(t)j  and  ^x(t+ At)J 
when  At  is  sufficiently  small.  The  difference  ^x  (t  +  At)  -  x(t)j  as  a 
linear  function  of  two  random  variables  will  be  normally  distributed 
when  x(t)  and  x(t+ At)  are  normally  distributed.  Assume  that  the 
joint  probability  density  function  of  x^  =  x{t)  and  X2  =  x(t+ At)  is  given 
by  the  joint  normal  distribution  ^1,  p.  12oj  , 
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where  the  mean  values  and  x^  equal  zero  and 

a^=  ((X2  -  )=  <(x2^)=  <x^t  +  At))  =  a^^t  +  At)  (5.42) 

~  ~  “  ^2^  )  ■  )■  i^2P(^>  t  +  At) 


As  usual,  the  angular  brackets  denote  ensemble  averages.  For  nonstationary 

2  2  2  2 

processes,  the  variance  quantities  cr  j  =  cr  ^  (t),  cr^  =  (^^(t  +  At),  and  the 

normalized  autocorrelation  function  p  =  p{t,  t  +  At)  are  functions  of  t  and 

2  2 

At.  For  stationary  processes,  =  *^2  ’  !<  P  “  p(At) 

alone. 

The  remainder  of  the  discussion  will  prove  that  the  derivative  x'(t) 
exists  in  the  mean  square  sense  if  the  (nonstationary)  normalized  auto¬ 
correlation  function  p'(t,t)  =  0  where 

p'(t,  t)  =  — ^ -  p(t,  t  +  At)  at  the  point  At  =  0,  t  fixed  (5.  43) 

d(At) 

Existence  in  the  mean  square  sense  is  defined  here  by  having  a  finite  value 
for  the  variance  of  the  quotient  of  Eq.  (5.  40)  as  At — ►O. 

To  prove  this  claim,  make  a  change  in  variable 

Xj  =  X  ;  X2  =  x+Ax  (5.44) 
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In  order  to  compute  the  one-dimenaional  probability  density  function 
for  Ax,  it  is  necessary  to  evaluate 


p{Ax) 


'OO 


p(x,  X  +  Ax)  dx 


'-00 


(5.46) 


After  some  manipulation,  one  can  verify  that  Ax  follows  a  normal 
distribution  with  zero  mean  value  given  by 


where 


p(Ax)  = 


Y  2it 


exp 


Ax 


-  (Ax)‘ 


2(r 


Ax 


Ax 


=  a 


U  .. 

+  <r  -  -  2  p  (T 


(5.47) 


(5.  48) 


This  result  proves  that  the  derivative  of  a  normally  distributed  random 
variable  will  also  follow  a  normal  distribution  since  the  derivative, 

Eq.  (5.40),  has  the  equivalent  definition 


x'(t)  =  lim 
At— 


(5.49) 


when  this  limit  exists. 

From  Eq.  (5.47),  the  variance  of  the  ruotient  (Ax/At)  is  given  by 


2 

Ax/At 


0" 

Ax 

(At) 


(7^  +  cr,  -  2po-^a^ 


(At;‘ 


(5.  50) 


where  p  =  p(t,  t+At)  is  a  function  of  t  and  At.  As  At — »-0,  the  numer- 
ator  expression  of  Eq.  (5.50)  becomes  (cr^  -  tr^)  '  since  p(t,  x)  =  1 
for  any  t.  To  evaluate  Eq.  (5  50)  in  the  limit,  one  should  expand 
p(t,  t+At)  in  a  power  series  about  At  =  0,  holding  t  fixed,  namely. 


p(t,  t+At)  =  I  +  p'(t,  t)  At  +  i  p"(t,  t)(At)^  + 


(5.  51) 
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Thus, 


At 


(o-^  -  -  2(r  ^p'(t,  t)  At  +  j  p"(t,  t)(  +  .  .  .  j 


(5.52) 


(At)‘ 


The  existence  of  the  derivative  x'(t)  in  the  mean  square  sense  is 
defined  by  the  existence  of  Eq.  (5.  52)  as  At--»0.  Now,  as  At— VO,  the 
standard  deviation  '  Thus,  for  small  At, 


2  t)  At  +  -^  p"(t,  t)(  At)^  +  .  .  .  I 

“"Ax/At  *  I 

(At)^ 

One  can  now  see  that  if  p'(t,  t)  ^  0,  then  Eq.  (5.  52)  does  not  exist  as 
At— ►0,  and  hence  the  derivative  x'(t)  does  not  exist.  However,  if 
p'(t,  t)  =  0,  then  as  At— >0,  Eq.  (5.  52)  becomes 


2 

^  AxfAt 


\  P"(t.t) 


where  t  is  considered  as  a  constant,  and 


p"(t.t) 


d 

d(At) 


d 

.  d(At) 


p(t,  t  +  At) 


at  the  point  At  =  0 


(5.53) 


(5.  54) 


Now,  the  derivative  expression  of  Eq.  (5.  49)  will  exist  in  the  mean  square 
sense.  Since  Eq.  (5.  53)  must  be  positive,  the  second  derivative  p"(t,  t) 
must  be  negative.  For  stationary  random  processes,  p"(t,  t)  =  p"(0), 
independent  of  t. 

Consider  next  the  transformation  of  moments  of  x(t)  due  to  the 
linear  derivative  operation.  Since  the  operations  of  averaging  and  differ¬ 
entiation  are  interchangeable,  the  first  order  moment  of  the  derivative 


-s 

\  x'(t)]  =  E  1  lim 

x(t  +  At)  -  x(t) 

^  l_At-*0 

At 

=  lim  fSJ 

;x(t+At)l  -E[x(t)ll 

d:Pj^t) 

At-^0 

At 

dt 

(5.  55) 


where 

;fi*(t)  =  E[x(t)] 


For  a  stationary  random  process,  since  ;p.  ^(t)  is  independent  of  t,  the 
first  order  moment  of  the  derivative  must  equal  zero. 
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Consider  the  mixed  second-order  moment  of  a  joint  derivative. 
Here,  one  obtains  the  extended  result 

)  -  x(t  rx{t,  + At,)  -  x(t,)1 


r  ,  rrx(t. +  At  )  -  x(t^)]r 


At. 


9tj  9^2 


where 


^^2  ^4’  =  E|x(t^)  xlt^)] 


(5. 56) 


Extension  of  Eq.  (5.  57)  to  higher  order  moments  of  n  derivatives  of  x(t) 
requires  an  n-fold  partial  differentiation  of  mixed  nth  order  moments  of 
x(t).  For  example, 


E[x'(t|)x'(t2)«'(t3)] 


‘3I 

3t, 


Further  discussion  of  these  ideas  and  material  in  the  preceding 
two  sections  appears  in  Ref.  ^  sj.  Many  practical  applications  of  these 
operations  for  electrical  and  mechanical  systems  are  developed  in  this 
reference. 


5.  9  INPUT-OUTPUT  RELATIONS  FOR  TIME- VARYING  LINEAR 
SYSTEMS 

Consider  a  nonstationary  random  process  ^x(t)j  acting  as  inputs  to 
a  time -varying  linear  system  with  weighting  function  h(a,t)  and  frequency 
response  function  ^(f,  t).  For  an  arbitrary  record  x(t)  belonging  to 
[  x(t)1  ,  the  output  y(t)  belonging  to  f  y(t)]  is 


y(t)  = 


h(a,  t)  x(t  -  q)  da 


(5.57) 


It  is  clear  that,  in  general,  ^y(t)J  will  be  a  nonstationary  random 
process  since  its  statistical  properties  will  be  a  function  of  t. 
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For  a  pair  of  times  the  product  y{tj)  y(t2)  is  given  by 


y(t^)y(t2) 


QO 

h(a,  t j)  h(P, t2)  x(tj 


-/-OO-^-OO 


a)  x(t2  -  P)  da  dP 


(5.  58) 


where  different  variables  of  integration  a,  p  are  used  to  avoid  confusion. 
Upon  taking  ensemble  averagesj  one  obtains 


Vr'2)  = 


h(a,  tj)  h(p,  t^)  R^(t  j  -  Q.  t2  -  P)  da  dP 


(5.  59) 


This  general  result  shows  how  an  output  nonstationary  autocorrelation 
function  may  be  determined  from  the  input  nonstationary  autocorrelation 
function  and  the  system  weighting  function.  The  operations  in  Eq.  (5.  59) 
all  take  place  in  a  real-valued  time  domain. 

By  transforming  to  a  complex-valued  frequency  domain,  one  can 
derive  the  equivalent  relation,for  nonstationary  power  spectrum  transforma¬ 
tions,  -00  ^00 


V'3'V  = 


•  00  J-co 


(5. 60) 


where 


'CD 


j2nfQt 


dt 


'-00 


(5.61) 


The  quantity  J(fj.fQ)  is  the  complex  conjugate  of  J(fj,fQ).  Equation 
(5.  60)  results  from  applying  Eqs.  (4.  17),  (4.  19);  and  (5.  4)  to  Eq.  (5.  59). 
For  a  physically  realizable  system,  one  uses  the  fact  that  h(a,  t)  =  0  for 
a«0  so  that  the  effective  lower  limits  in  Eq.  (5.  59)  can  be  changed  to 
-00  without  changing  the  result. 

If  S^(fj,f2)  =  ^(^2  '  ^1^’  ^  stationary  process,  then  Eq.  (5.  60) 

becomes 


S  (f., 
y  3 


■vf. 

•^-00 


J(f2'  h  ■  h  ■  V 
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When  the  system  is  a  constant  parameter  linear  system,  where 
,V{fj»t)  =y(fj)  independent  of  t,  Eq.  (5.61)  becomes 


•oo 


'-00 


j2irfQt 


dt  =7/(fj)6(fo)  (5.63) 


where  6(fQ)  is  the  usual  Dirac  delta  function.  Now,  Eq.  (5.  60)  yields 

S  (f3.f4)  =^)^(f4)S^(f3,f4) 


where 


■oo 


V(f)  =  /  h(  q)  da 


(5.  64) 


(5.65) 


'-00 


For  the  special  case  of  stationary  random  processes  where 
jJ  (f-,  f .)  is  nonzero  only  for  f  =  f.  =  f .,  Eq.  (5.  64)  reduces  to  the 


familiar  result 


s  (f)=|V(f)|^s  (f) 


(5.  66) 


The  change  in  form  exhibited  by  Eqs.  (5.  60),  (5.  62),  (5.  64),  and  (5.  66)  is 
worthy  of  note. 

Further  interesting  input-output  relations  can  be  found  by  examining 
the  nonstationary  cross-correlation  function,  and  nonstationary  cross - 
power  spectral  density  function  between  the  input  process  j 

output  process  [y(^)J-  From  Eq.  (5.  57),  the  product  of  x(tj)  by  y(t2)  is 


■oo 


x(tj)y(t2)  =  /  h(P,  t2)  x(tj)x(t2  -  P)  dP 

J-oo 

The  taking  of  ensemble  averages  now  yields 


R  (t 
xy' 


J-oo 


h(P,t2)R^(tj,t2-  P)  dp 


(5.67) 
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Equation  (5.  67)  is  a  general  result  in  the  real-valued  time  domain 
between  the  nonstationary  input  autocorrelation  function,  the  time- 
varying  linear  system  weighting  function,  and  the  nonstationary  input- 
output  cross-correlation  function. 

When  Eq.  (5.  67)  is  transformed  to  a  complex-valued  frequency 
domain,  there  results  from  Eqs.  (4.  20)  and  (5.  4)  after  a  certain  amount 
of  straightforward  manipulation  the  nonstationary  cross-power  spectrum 
relation 

V'3-V=f  (5.68) 

-'-OO 

The  quantity  J  is  defined  by  Eq.  (5.  61).  Observe  that  the  form  of 
Eq.  (5.  68)  is  simpler  than  the  form  of  Eq.  (5.  60). 

'  ^2^’  ^  stationary  process,  then  Eq.  (5.  68) 

become  s 

"  S^(f3)J(f3,f3-  f^)  (5.69) 

For  the  important  class  of  constant  parameter  linear  systems, 

Eq.  (5.  68)  becomes  with  the  aid  of  Eq.  (5.  63), 

V3’ '4>  =  V  '4> 

Upon  further  reduction  to  the  special  case  of  stationary  random  processes, 
Eq.  (5.  70)  becomes  the  stationary  cross-power  spectrum  relation 

S^y(f)  =  ,^^{f)S^(f)  (5.  71) 

This  result,  like  Eq.  (5.  66)  is  well-known  and  provides  a  required  check 
on  this  work. 
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6.  EXAMPLE 

NONSTATIONARY  PROCESS  RESULTING  FROM 
AMPLITUDE  MODULATED  AND  FILTERED  STATIONARY  PROCESS 

The  following  example  is  taken  from  Ref.  ^  1  j  of  Section  4.  The  nota¬ 
tion  has  been  changed  to  agree  with  the  present  material,  and  additional 
expressions  have  been  calculated  to  illustrate  special  formulas  that  have 
been  derived  in  Sections  4  and  5  which  do  not  appear  in  Ref.  [  Knowledge 
of  the  spectral  changes  occurring  in  this  system  may  be  useful  to  designers 
of  spectrum  simulators,  in  addition  to  helping  to  explain  certain  observed 
physical  phenomena. 


A(t)  =  cos  ZffFt 


tr 


z(t) 


(1)  Assume  that  the  amplitude  modulated  time-varying  output 


•oo 


y(t)  = 


a(a,  t)  x(t  -  a)  da  =  A(t)  x{t) 


'-00 


(6.1) 


Hence  the  time -varying  weighting  function 


a(a,  t)  =  A(t)6(a)  (6.2) 

where  6(a)  is  a  delta  function.  Note  that  a(a,  t)  =  0  for  a  0  so  that 
this  time-varying  operator  is  physically  realizable.  In  fact,  the  output 
y(t)  depends  only  upon  the  input  x(t)  at  time  t  and  is  not  effected  by  any 
of  its  past  behavior.  For  this  example,  let  A(t)  be  a  cosine  wave 

A(t)  =  cos  ZwFt  where  F  =  constant  (6.  3) 

(2)  Assume  that  the  filtered  constant  parameter  output 


-oo 


z(t)  = 


h(a)  y(t  -  a)  da 


'-00 


(6.4) 


where  h(a)  is  described  by  its  frequency  response  function  ^(f)  as  an 
ideal  bandpass  filter. 
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t  1 

-'h 

-‘l 

o 

CD 


:V(f)  =  da 


'-CO 


1  fL=l'l  =  ‘H 


=  0  otherwise 


(6.  5) 


Now,  from  the  inverse  to  Eq.  (5.65),  the  constant  parameter  weighting 
function  of  a  bandpass  filter  is  given  by 

h(a).l  y(f)  df 

(6.  6) 

2 

wa 


8injw(fj^  -  fj^)  ajcos^w  (f +  f^^)  aj 


The  case  of  a  lowpass  filter  where  f  =  0  is  given  by 


2  sin  “• 

h(a)  = -  sin  irf,,  a  cos  wf„  a  s  - 

ira  “  " 


(6.  7) 

Note  that  h(a)  ^  0  for  q>«0  so  that  constant  parameter  bandpass  or  low- 
pass  filters  are  not  physically  realizable  unless  this  restriction  is  imposed. 


(3)  Assume  that  the  stationary  random  process  x(t)  has  zero  mean  value 
and  has  a  constant  power  spectral  density  function  corresponding  to  band¬ 
width  limited  white  noise,  namely 


S  (f) 

X 


S,(f)  =  1 


=  0 


|f|:ff 


(6.8) 


otherwise 


The  corresponding  stationary  autocorrelation  function  from  Eq.(4.29) 
is 

f  sin  2irf  x 

S  (f)  df  =  - (6.  9) 

^  ITT 


V..  ■  / 

J-CO 


which  is  the  same  form  as  the  weighting  function  of  a  lowpass  filter. 

Note  that  the  variance  R  (0)  =  2f 

x.  c 
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Problem :  Compute  the  various  stationary  and  nonstationary  corre¬ 

lation  functions  and  spectral  density  functions  corresponding 
to  the  output  records  •  individuallyi  pair¬ 

wise,  and  relative  to  the  input  records  |^x(t)j  . 

1.  Properties  of  ^y(oj 

First  of  all,  consider  the  intermediate  random  process  j  y(t)j. 

From  Eqs.  (4.  8),  (6.  1),  and  (6.  3)  the  autocorrelation  function 

=  cos  2irFt.  cos  ZirFt,  R  (t-  -  t.) 

1  2x2  1 


cos  2iTF{tj  +  t^)  +  cos  2iTF(t2  -  tj) 


R  (t,  - 


where  Rj^(t)  =  Rj^(t2  '  given  by  Eq.  (6.  9).  From  Eq.  (4.  33) 


n  y(t.  T)  =  i 


cos  4irFt  +  cos  2nFT 


R  (t) 

X 


(6.  11) 


Thus,  y(t)  is  a  nonstationary  random  process  since  its  autocorrelation 

function  is  not  independent  of  t.  Note  that  Ry,(t,  t)  is  locally  stationar; 
since  it  is  separable  into  the  product  of  functions  of  t  and  t,  namely 


(t,  T)  =  R,V')R2a'^>  * 


(6.  12) 


where 


RiA^^)  =  y  cos  4wFt  ; 


R2b^^)  =  [cos  2irFT]R^(T) 


(6.  13) 


The  mean  value  of  y(t)  is  zero  when  the  mean  value  of  x(t)  is 
zero  because  of  the  linear  operation  involved.  Hence  the  variance  of 
y(t)  is  given  by  ^y.(t,  0)  =  (l/2)(i  +  cos  4irFt). 


(6.10) 
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From  Equations  (4.  40),  (4.  41),  and  (4.42),  the  nonstationary  power 
spectral  density  function  corresponding  to  Eq.(6.  12)  is 


where 


S.A<''  =  t 


6(f  -  2F)  +  6{f  +  2F) 


^2B^®^  "  2 


S2A(g)  = 

(6.  15) 


Sjg  -  F)  +  S^{g  +  F) 


Relative  to  the  plane,  from  Eqs.  (4.  35), 


V'<'hl=  y 


'h  -  h'’ 


h  * 


(6,  16) 


Equations  (6. 14)  and(6. 15)  show  that  the  function  j«^^{f,  g)  exists  only 
along  the  lines  f  =  0  and  f  =  ±  2F  in  the  (f,  g)  plane.  Consequently, 
since  f  =  f^  -  fj.  the  function  Sy(fj,f2)  exists  only  along  the  lines 
^2  ~  ^1  ^2  ~  ^  plane. 

2.  Joint  Properties  of  |^x(t)j  and  y(f)j 

Consider  next  the  pair  of  random  processes  ^x{t)j  and  • 

From  Eq.  (5.69),  since  x(t)  is  stationary,  the  nonstationary  cross-power 
spectral  density  function  given  by 


(6.  17) 


where 


J(f 


J-(X> 


j2*f  t 

A(fj,t)e  dt 


(6.  18) 
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For  the  present  eKample,  from  Eqs.(6.  2)  and  (6.  3), 


A(fj.t)  =  A{t)  =  cos  ZwFt 


(6.  19) 


Hence 


•GO 


jZirfoi 

COS  ZirFte  dt 


=  T  [‘»0  -  "  *■>] 


(6.  20) 


Equations  (6.  17)  and  (6.  20)  now  yield 

‘4'  =  I  S^l'3'1‘1'4  -  tj  *  "  “'4  -  '3  ■  *■'] 

(6.  21) 

Thus,  the  delta  functions  in  Eq.  (6.  21)  show  that  the  function 
exists  only  along  the  lines  f^  =  f^  ±  F  in  the  (f^,  f^)  plane.  From 
Eq.  (4.  35),  by  a  change  in  variables  to  the  (f,  g)  plane,  one  derives 

■^xy^^’8’  =  ^xy^«  *1  ’  *  =  i  ^x^®^  -|)[  6(f  +  F)  +  6(f  -  F)  ] 

(6.  22) 

=  I  ^x<®  ^  ^  I  V® 

(6.  23) 

The  nonstationary  cross-correlation  function  is  given  by 
^xy^^3’‘4^  ^  3)  7(^4))  =  (xlt^)  A(t^)x(t^)^ 

=  A(t4)R^(t4  -  t3)  =  [cos  ZirFt^jRjt^  -  13)  (6.  24) 

From  Eq.  (4.33)this  is  equivalent  to 
if^y(t,  t)  =  cos  2iTF(t  -  I)r^(t) 

=  cos  2TrFt[R^(T)  cos  TTFxj  +  sin  2iTFt[R^(T)  sin  uFt j 

(6.  25) 

Thus  R  (t,  t)  is  of  a  separable  form.  The  cross-covariance  R  (t,0)  =  cos  2irFt. 
xy  xy 
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Transformation  of  Eq.  (6.  25)  as  was  done  previously  in  obtaining 
Eqs.  (6.  14)  and  (6.  15)  will  yield  (6.  23),  providing  a  necessary  check  on 


the  work. 

An  alternative  method  which  gives  another  check  on  the  validity  of 
Eqs.  (6.  14)  and  (6.  15)  can  be  obtained  by  substituting  Eq.  (6.  20)  into 
Eq.  (5.  62).  This  yields 


'■00 


-'-00 

+  6(f2  -  ^4  f')  ]  ^^^2 

+  Sjf3  -  F)  6(f^  -  f^  +  2F)  +  -  F)  6(f^  -  f^)] 


F) 


(6.  26) 


In  deriving  Eq.  (6.  26),  there  is  need  of  the  fact  that  S^(f)  and  6(f)  are 
both  even  functions  of  f.  The  reason  for  writing  Eq.  (6.  26)  in  this  form 
is  to  bring  out  the  fact  that  S^l-fj,  -f^)  =  S^lf^.f^).  Now,  from  Eq.  (4.35), 
by  substituting  obtains 


=  S  (g  -I  ,  g  +i) 


f , 


=  j  [s^(g  +^+  F)  6(f)  +  S^(g  +  F)  6(f  -  2F) 

(6.  27) 

+  S^(g  -  |  -  F)  6(f  +  2F)  +  S^(g  +  ^  -  F)  6(f)] 

=  ;j[s^(g  +  F)  6(f)  +  S^(g)  6(f  -  2F)  +  S^(g)  6(f  +  2F)  +  S^(g  -  F)  6(f)] 

(6.  28) 


which  is  precisely  Eq.  (6.  14). 
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using  Eq.  (4.  Z9)to  obtain  the  ^-^^(14  ■  *^3)  term. 

Similarly,  one  can  derive  Eq(6.  10)  from  Eq.  (6.  26)  by  substituting 
Eq.  (6.  26)  into  Eq.  (4.  16)  and  carrying  out  the  various  manipulations 
that  are  required. 
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3.  Properties  of  z(t) 


The  problem  of  determining  properties  of  the  final  output  process 
|^z(t)j  IS  more  difficult  because  of  the  filtering  effects  and  will  now  be 
considered.  From  Eq.  (5.  64),  the  nonstationary  power  spectral  density 
function  is  given  by 

S^(f3.  f^)  =  Sy(f3.  i^)  (6.  29) 


For  this  example,  given  by  Eq.  (6.  26),  whereupon  it  follows 

that  S^(f3if^)  exists  only  along  the  lines  f^  =  f3  and  f^  =  f3  ±  2F  in 
the  (f3, f^)  plane. 

From  Eq.  (6.  5),  the  frequency  response  function  V(f)  equals 


unity  only  for  f  —  lf|— f„,  and  is  zero  elsewhere.  Hence  the  product 
j-i  rl 

equals  unity  only  within  the  four  squares  in  the  {f3,f^)  plan 
bounded  by  '  ^L~  **  zero  elsewhere.  See 


sketch. 
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From  Eq.  (6,  29).  it  now  follows  that  the  function  S^(fj)f^)  is  equal 
to  zero  except  along  the  portion  of  the  lines  ^4  =  ^3  ^4  “  ^3^ 

which  he  inside  one  of  these  four  squares.  In  particular,  f^  =  f^  will 
always  cross  the  two  squares  in  the  first  and  third  quadrants,  while 
f^  =  f j  ±  2F  will  cross  these  same  two  squares  if  and  only  if  2F"=(fpj-f 
There  is  no  crossing  of  the  two  squares  in  the  second  and  fourth  quad¬ 
rants  unless  2F^f„.  It  will  be  assumed  that  2F=f„,  so  that  only  the 

H  ri 

crossings  in  the  first  and  third  quadrants  need  be  considered. 

Thus,  if  fH=  2F2(fj^  -  fj_^).  from  Eqs.  (6.  26)  and  (6.  29), 


'4'  =  7^*'“  *  ‘<'4  -  '3>1  50) 

while  if  2F'^{f„  -  f.  ),  then  in  addition  to  the  above, 

H  1j 

Sz''3’'4'  =  jK‘'3  *  '■'‘<'4  -  b  •  "  Vb  -  '■>‘<'4  -  '3  * 

(6.31) 

Note  that  -f^)  = 

From  Eq.  (6.  8),  the  terms  S^Cf^  +  F)  and  S^(f^  -  F)  are  zero  for 
all  f^  except  when 


S^(f4  +  F)  =  1 
Sjf4  -  F)  =  1 


-f  -  F^  f.  «f  -  F 

c  4  c 


-f  +  F2  f.  <f  +  F 

c  4  c 


(6.  32) 


Assume  that  f  2:f„  +  F  so  that  the  terms  of  Eq.(6.  32)  are  positive 

C  —  4 

inside  the  square  bounded  by  fj^^f^^fj^,  =  U=‘h-  A  similar 

condition  exists  for  S^ifj  +  F)  when  f^  2  f ^  +  F. 
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By  Eq.  (4.  16)  and  the  remarks  following  Eq.  (6.  29),  the  autocorre¬ 
lation  function  present  example  is  now  given  by 


^<'3'9>  = 


-0  rO  1^00  /~co 
^03  J-ao  Jq 


-jZtrlf^t^-f^t^) 


dfj  df^ 


=  2 


H  r  H 


L  L 


S^(f3.f4)  cos  2n({^t^  -  f3t^)  df3  df^  (6.  33) 


since  S^( -13. -f^)  =  S^(f3,  f^) 


If  f„  5  2F  =  (f„  -  f.  ),  then  substitution  from  Eqs.(6.  30)  and  (6.  32) 
H  Hi-/ 


yields 


H  r  H 


^2(^3-  ^4)  - 


6(f^  -  f3)  cos  2w(f4t^  -  f3t3)  df3  df^  (6.  34) 


On  setting  f  =  14  -  13,  df  =  -df3,  one  obtains 


-'h  r‘4-‘L 


RJt,.  (4)  = 


6(f)  cos  2Trj^f4(t^  -  t3)  +  ft3  ]  df  df^ 


H 


cos  2iTf4(t^  -  t3)  df^ 


sinfirif  -  fr  >(^4  -  4)] 

=  (fH  -  v  ^  -  h>]  ^ 

w(fH  -  fL)(f4  -  ^3) 

(6.35) 

Since  R-2^^3’ ^4^  ^  function  only  of  (t4  -  t3),  the  output  process  ^z(t)j 

is  stationary  here. 

The  mean  value  of  z(t)  is  zero  when  the  mean  value  of  y(t)  is 
zero  because  of  the  linear  nature  of  the  bandpass  filter.  Hence  the 


variance  of  z(t)  is  given  by  R  (t,  t). 
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From  Eq.  (^>'  35), 


R^(t.  t)  =  (fn  -  when  = 

which  is  seen  to  be  independent  of  t  here. 

If  2F'*{fj^  -  fj^)i  then,  from  Eq.(^>-  31),  in  addition  to  Eq.(6.  35), 
the  autocorrelation  function  includes  the  term 


=tI  I  [6(f4-f3  +  2F)  +  6(f^-f^-2F)]coa  2n(f^t4  -  f3t3)  df^  df^ 

(6.  37) 

=  -j  I  ”[  ^[6(f+2F)  +  6(f  .-  2F)]co8  2«[f4{t^  -  t^)  +  ft^Jdf  df^ 

on  setting  f  =  f^  -  f^,  df  =  -df^.  In  order  to  interpret  and  evaluate  this 
expression  properly,  it  is  now  necessary  to  change  the  order  of  integration 
between  f  and  f^.  The  sketch  below  shows  how  to  find  the  new  limits, 
and  shows  that  for  this  case  one  must  break  up  the  integration  into  two 
parts  when  the  limits  are  reversed. 
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Thus,  the  result  of  changing  the  order  of  integration  gives  a  pair  of 
double  integrals,  namely, 


where 


=  AJty  t,,!  (6.  38) 


[6(tt  2F)  +  6(f  -  2F)]  COS  -  ^3)+  ft3jdf^  df 

(6. 39) 

M  /  [6(f+ 2F)  +  6(f  -  2F)]cos  2ir[f4(t^ -t^l  +  ft^jdf^  df 

T)  ^f,  +f 


f  -f  ^f 
L  H  L 


If  desired,  one  can  now  carry  out  these  integrations  for  the  general  case 
of  arbitrary  t^  and  t^.  The  result  will  be  fairly  complicated. 

For  the  special  point  where  ^3  "  ^4  “  obtains  for  the 

variance  of  z{t),  in  addition  to  Eq.  (6.  36)  the  term 


R  (t,  t)  =  A  (t,  t)  +  B  (t,  t) 
z  z  z 


(6.  40) 


where 


Ajt.t) 


2 


H 


+f 

^6(f+  2F)  +  6(f  -  2F)jcos  2nft.^  df^  df 


f  -f  f 
L  H  L 


1  /  (f„  -  f,  +  f)  6{f  +  2F)  cos  2Trft  df 

2  /  H  L 

'l-'h 


1  (f„  -  f,  -  2F)  cos  4TTFt 

2  rl  i-i 


(6.41) 
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and 


=  -  (f„  -  f,  -  2F)  cos  4irFt  (6.  42) 

2  H  L 


Hence,  the  additional  variance  when  2F^(fpj  -  is  given  by 

R  (t,  t)  =  (f„  -  f,  -  2F)  cos  4TrFt  (6.  43) 

z  rl 


Since  this  term  is  not  independent  of  t,  Eq.  (6.  43)  proves  that  the 
autocorrelation  function  is  nonstationary  when  ZF**  fj^  -  fj^-  Note  that 
Eq.  (6.  43)  becomes  zero  when  2F  =  (f^^  -  fj^).  The  complete  variance 

for  cases  when  2F  (fj^  -  f j^)  is  the  sum  of  Eqs. (6.  36)  and  (6.  43), 
namely, 


when  2F'*(fj^  -  f^)- 


(6.  44) 
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4.  Joint  Properties  of  |^x;(t)j  and 

Substitution  of  Eq.  (^-  U  into  Eq.  (6.  4)  gives 


z{t)  = 


rco 

/  h(a)A{t  -  a)jx(t  -  a)  d( 
-'-00 


(6.45) 


which  shows  how  z(t)  is  related  to  x(t).  From  Eq.  (5.  69)  the  non- 

stationary  cross-power  spectral  density  function  S  is  given  by 

X  Z  V 


(6.  46) 


where 


-oo 


J{fi.fo)  = 


V(f 


j^irffvt 

.  t)e  dt 


/-oo 


It  follows  from  Eq.  (6.  45)  that 


roo 

Vlff.t)  =  1  [h{a)A(t  -  a)je 

-/-CD 


-jZwf jtt 


da 


(6.  47) 


(6.48) 


From  Eqs.  (6.  3)and(6.  5),  using  a  complex  form  for  cos  t, 


^(fj-t)  = 


1 

I 


■  oo 


/-oo 


j2TrF(t-a)  -j2iTF(t-Q) 
h(a)  e  +  e 


-jZirfjQ 


da 


^jZwFt^^^^  +  F)  +  -  F) 


(6.  49) 


Substitution  of  Eq.  (6.  49)  into  Eq.  (6.  47)  yields 


J(fj,fQ)  =  j[?/(fj  +  F)6(fQ  +  F)  +  -  J^6(fo  -  F)] 

(6.  50) 
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Hence,  from  Eqs.  (6.  46)  and  (6.  50), 


®xz<'3''4’  =  2  S_^(f3)[>'(f3+F)6(q-f3-F)ty(f3-F)6(£^-f3+F)] 

(6.51) 

From  Eq.  (6.  5),  the  terms  +  F)  and  2®*“°  except 


when 

+  F)  =  I 

y(f3  -  F)  =  1 


(6.  52) 


The  delta  functions  in  Equation (6.51)  now  show  that  exists  only 

along  the  line  f^  =  f^  +  F  in  the  (f^,  f^)  plane  where  +  F)  =  1,  and 

the  line  f^  =  f^  -  F  in  the  (^3*^4)  plane  where  )/{{^  -  F)  =  I  ■  Note  that 
S  -^.i)  =  S  (f-,f.).  If  F— f,  ,  then  in  the  first  quadrant, 

y  (£3  t  F)  =  I  when  £  -  F:  £3^  £  -F  and  ^(£3  -  F)  =  I  when 

Assume  that  f  =  (!„  +  F)  so  that  S  (f,)  will  be  unity  inside  the 
regions  covered  by  Eq.  (6.  52).  From  Eqs.  (4.  16),  (6.  51),  and  (6.  52), 
the  cross-correlation  function  ^xz^*^3' ^4^’  Fifj^,  is  now 

given  by 
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5.  Joint  Properties  of  [y(oj  and  |^z(t)j 

From  Eq.  (5.  70),  the  nonstationary  cross-power  spectral  density 
function  f^)  is  given  in  this  example  by 

where  ^(f^)  is  defined  by  Eq.  (6.  5),  namely, 


^(f^)  =  1 


=  0 


f  f  *=f 
’  L- 


otherwise 


(6.  58) 


and  S  (f.j,f.)  IS  derived  in  Eq.  (6.  26).  It  follows  that  S  (f-,f.)  exists 
y  3  4  ^  \  I  y^'  3 

only  along  the  lines  f^  =  f^  and  =  f^  ±  2F  in  the  (f^,  f^)  plane  where 

7/  (f^)  =1,  and  S^(£^  ±  F)  =  1,  S^{£^  ±  F)  =  1,  see  Eq.  (6.  26).  The 

sketch  below  assumes  that  2F ^  f j^.  For  simplicity,  other  cases  will 
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It  will  be  assumed  that  f  ^  (£„  +  'F)  so  as  to  have  S  i  F)  =  1 

c  ri  X  T 

inside  the  region  From  Eqs.  (4.  16)  and  (6.  57),  for 

2F=f.  t  the  cross -correlation  function  R  (t,.t.)  becomes 
L  v  z  ,5  4 


noo 

2ir(f^t^  -  f^t^)  df^  df^ 

-f.,  ^oo 


=  jJ  [26(f4-f3)  +6(f^-f3+  2F)  +6(f4-f3-2F)](6.  59) 


cos  2iT(f^t^  -  f^tj)  df^  df^ 

■•h 


COS 


2Trf4(t4  -  ‘3)  +  I 


'f. 


+  ^cos  2tr  [£4(14-13)  -  2Ft3  ]  j  df^ 


=  (I  +  cos  4wFt3)  /  cos  27Tf4(t4  -  13)  df^ 

which  is  integrated  easily  if  desired. 

Finally,  the  cross-covariance  term  is  given  by 


(6.  60) 


R  (t,  t)  =  (f„  -  f-  ){1  +  cos  4TrFt)  when  2FS  f.  (6.  61) 

yz  H  L  E 


This  concludes  the  cases  of  the  example  that  will  be  treated  here. 
Further  work  is  required  to  cover  other  possible  parameter  relations 
that  might  be  considered.  The  results  carried  out  here  illustrate  the 
application  of  formulas  derived  in  preceding  sections  for  analyzing 
input-output  relations  of  nonstationary  random  processes  through 
time -varying  linear  systems. 


ASD  TDR  62-973 


6-18 


7.  SAMPLING  CONSIDERATIONS  FOR  FLIGHT  VEHICLE 
VIBRATION  PROBLEMS 


7.1  INTRODUCTION 

When  measuring  the  vibration  environment  in  a  flight  vehicle, 
the  flight  is  usually  much  too  long  to  record  in  its  entirety.  With  available 
tape  speeds  of  30  or  even  60  inches  per  second,  often  only  a  small  portion 
of  the  vibration  flight  history  can  be  recorded.  It  is  easy  to  arrive  at  the 
conclusion  that  in  order  to  obtain  a  representative  picture  of  the  vibration 
environment  for  the  entire  flight,  samples  should  be  taken  during  the 
various  phases  of  the  flight,  each  sample  being  only  a  few  seconds  long. 
However,  it  is  more  difficult  to  arrive  at  a  quantitative  conclusion  as  to 
how  representative  these  samples  are  for  this  flight,  and  how  accurately 
the  vibration  environment  of  another  flight  can  be  predicted. 

A  considerable  amount  of  work  has  been  done  in  developing 
quantitative  results  for  procedures  used  in  quality  control  and  inspection 
sampling  plans.  Generally  a  sample  is  drawn  from  a  population,  measure¬ 
ments  are  made  on  the  sample  and  sample  parameters  are  calculated, 
which  then  provide  an  estimate  of  the  corresponding  population  parameters. 
In  addition,  confidence  limits  can  be  established  for  the  population  para¬ 
meters,  providing  a  quantitative  rheasure  of  the  risk  of  having  made  a 
wrong  estimate. 

It  would  seem  that  such  a  procedure  could  also  be  established 
for  measuring  the  vibration  environment  in  flight  vehicles.  However,  there 
are  a  number  of  difficulties  that  have  to  be  resolved.  For  example,  the 
vibration  samples  are  not  from  a  population  of  discrete  items,  but  from  a 
time -dependent  function.  Often  this  time  dependent  function  is  considered 
as  random.  Even  the  concept  of  "population"  is  not  clear.  It  could  be  the 
vibration  record  for  one  complete  flight  or  for  several  flights  or  maybe 
just  for  a  particular  flight  phase.  One  very  important  requirement  in  in¬ 
spection  sampling  is  that  the  population  parameters,  which  are  to  be 
estimated,  do  not  change  with  time.  Yet,  for  example,  the  rms  accelera¬ 
tion  level  in  a  missile  does  vary  considerably  throughout  the  length  of  the 
flight.  This  requires  the  consideration  of  "nonstationarity"  concepts. 
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Another  question  involves  a  choice  of  sampling  at  random  or 
periodically.  Then  the  "optimum"  length  of  the  sample  has  to  be 
determined,  taking  into  account  the  effect  of  sample  length  on  the  accuracy 
of  the  parameters  to  be  estimated.  It  is  the  purpose  of  this  section  to  look 
at  the  various  aspects  of  "sampling  of  a  time -dependent  process"  and  to 
propose  methods  that  will  result  in  obtaining  the  maximum  amount  of  in¬ 
formation  from  a  minimum  amount  of  vibration  data  with  a  known  confi¬ 
dence  in  the  results. 

The  collection  of  vibration  records  under  consideration  may  be, 
for  example,  different  samples  of  the  vibration  amplitude  response  at  a 
particular  point  on  the  structure  of  a  given  flight  vehicle  during  a  long 
mission.  Other  examples  might  be  a  collection  of  vibration  records  as 
obtained  from  many  different  locations  on  the  structure  of  the  given  flight 
vehicle  during  one  flight;  or  the  collection  of  records  might  be  obtained 
from  the  same  location  but  over  many  different  flights  of  the  given  flight 
vehicle.  A  number  of  different  flight  vehicles  might  also  be  involved. 
Clearly,  there  are  a  large  number  of  possible  physical  variations  that 
might  be  considered. 

Regardless  of  the  physical  origin  of  the  samples,  the  main 
problem  is  to  analyze  over-all  statistical  properties  associated  with  the 
collection  of  samples.  In  some  situations,  prior  analysis  will  have  been 
made  of  statistical  characteristics  of  each  sample  by  itself. 

A  second  problem,  where  it  is  applicable,  is  to  determine  in 
advance  an  appropriate  number  of  samples  which  should  be  gathered  for 
later  analysis.  A  properly  selected  finite  set  of  samples  can  reproduce 
the  underlying  population  such  that  more  samples  provide  little  additional 
information.  Attention  to  this  matter  can  result  in  substantial  savings 
both  in  gathering  data  and  subsequent  processing.  This  matter  is  dis¬ 
cussed  in  Section  7. 2  under  the  heading  of  Random  Sampling,  a  review  of 
material  from  Ref.^lj.  In  Section  7.3,  periodic  sampling  of  random  data 
is  shown  to  lead  to  equivalent  results  if  data  is  both  random  and  stationary. 

From  a  collection  of  vibration  records  (samples),  many  parameters 
may  be  calculated  for  comparison  with  one  another,  such  as  mean  square 
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values,  power  spectral  density  functions,  amplitude  probability  density 
functions,  extreme  values,  et  cetera.  Assume  the  records  are  obtained 
with  instrumentation  that  has  no  DC  response  so  that  the  mean  value  of 
each  record  is  automatically  zero.  This  agrees  with  much  physically 
observed  random  data.  For  definiteness,  assume  for  the  present  dis¬ 
cussion  that  the  individual  mean  square  values  are  calculated.  A  single 
number,  the  mean  square  value,  now  represents  each  record.  Each 
such  number  will  have  associated  with  it  a  statistical  uncertainty,  based 
on  the  number  of  degrees  of  freedom  involved  in  its  measurement.  Two 
cases  arise  according  to  whether  or  not  one  has  available  and  utilizes 
quantitative  information  of  this  uncertainty.  Formulas  for  estimating 
uncertainty  in  measured  sample  values  are  discussed  in  Section  7.4,  and 
methods  for  testing  fundamental  assumptions  are  discussed  in  Section  7. 

The  collection  of  sampled  values  can  originate  either  from  a 
single  experiment  (e.g.  ,  vibration  data  from  a  single  point  during  one 
flight),  or  from  a  number  of  different  experiments  (e.g.  ,  vibration  data 
from  one  or  many  points  during  one  or  many  flights).  For  the  sake  of 
having  a  convenient  summary  of  appropriate  formulas  in  one  place. 
Section  7.6  reviews  material  from  Ref|l|for  carrying  out  a  statistical 
evaluation  of  data  from  single  points  (single  experiments).  This  leads 
naturally  to  the  next  Section  8  of  this  report  devoted  to  statistical  pro¬ 
cedures  for  evaluating  data  from  many  points  (many  experiments). 

7 . 2  RANDOM  SAMPLING 

A  major  consideration  in  any  data  analysis  is  the  extraction  of 
the  maximum  amount  of  information  from  the  minimum  amount  of  data. 
Selection  of  an  appropriate  sampling  scheme  (random  or  periodic)  can 
both  decrease  the  volume  of  data  required  and  still  reproduce  the  popu¬ 
lation  with  desired  precision.  Knowing  the  mean  time  between  samples, 
the  distribution  of  these  times,  and  the  length  of  each  sample,  quanti¬ 
tative  results  can  be  obtained  allowing  the  prediction  of  any  given 
(vibration)  level  occurring,  how  often  this  level  might  occur,  how  well 
the  samples  represent  the  entire  range  of  (vibration)  levels,  and  the 
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minimum  number  of  samples  required  for  a  given  confidence  in  the 
results . 

For  reasons  of  simplicity  both  in  instrumentation  and  in  later 
statistical  analysis,  the  sample  length  should  be  of  fixed  duration.  In 
a  random  sampling  scheme,  only  the  time  interval  between  samples 
should  be  random.  Prior  knowledge  of  the  sample  length,  and  of  the 
frequency  range  being  recorded,  enables  one  to  make  valid  statistical 
estimates  about  the  accuracy  of  various  measurements  of  interest, 
such  as  power  spectrum  measurements  or  probability  density  measure¬ 
ments.  On  the  practical  side,  instrumentation  problems  of  recording 
such  data  appear  to  be  simplified  if  it  is  decided  in  advance  that  each 
sample  length  should  be  of  a  certain  definite  duration. 

Figure  7.1  is  a  block  diagram  of  a  recommended  procedure 
to  follow  in  the  selection  of  a  random  sampling  plan.  The  blocks  will 
be  discussed  in  order  and  illustrated  by  examples-  Ref.  ^  1  j  may  be 
consulted  for  more  detailed  comments. 


Block  A  Experiment  Specification  and  Equipment 


Reference 


gives  detailed  procedures  to  follow  for  specifying 
equipment  for  the  flight  vehicle  vibration  situation.  Some  similar 
analysis  would  be  necessary  in  other  physical  problems. 


Block  B  Sample  Length  Determination,  Mean  Time  Between  Samples 

Several  physical  constraints  exist  such  as,  for  example,  the 
length  of  a  sample  should  be  at  least  as  long  as  the  period  of  the  lowest 
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frequency  of  interest.  Besides  the  physical  constraints,  engineering 
and  statistical  considerations  are  required  to  resolve  interrelations 
existing  between  the  sample  length  and  the  mean  time  between  samples. 
These  matters  are  reviewed  in  the  text  for  Blocks  C  and  D,  and  extended 
in  considerable  detail  in  Sections  7.4,  7.5,  and  7.6. 


Figure  7.1.  Over -all  Recommended  Procedure  for 
Selection  of  Sampling  Scheme. 


Block  C  Detection  of  Unexpected  Events 

Certain  important  unexpected  events  might  be  missed  in  sampling 
from  a  random  process.  It  is  of  interest  to  know  the  probabilities  of 
missing  these  events  for  a  given  sample  length  and  a  given  mean  time 
between  samples.  Considered  from  the  other  direction,  if  a  probability 
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is  prescribed,  then  the  mean  time  between  samples,  and  the  sample 
length  will  be  partly  determined.  For  the  subsequent  discussion,  let 

e  =  length  of  unexpected  event  in  seconds 

T  =  length  of  each  sample  in  seconds 

L  =  mean  time  between  samples  in  seconds 
(measured  from  center  to  center) 

Fig.  7. 2.  shows  a  possible  sequence,  given  that  e  will  occur  once  during 
time  L. 


time 


Figure  7.2.  Example  of  Random  Sampling 


The  average  probability  of  missing  all  parts  of  e,  denoted  by 


P,  is 


Pimissing  e)  =  ^  ^ 


=  1  -  1±1.  (7.  1) 


assuming  e  >0  and  (T  +  e)<  L.  This  equation  does  not  apply  to  situ¬ 
ations  of  predetermined  fixed  sample  lengths  and  fixed  time  between 
samples.  For  predetermined  fixed  sampling  times, 

^0  if  e  occurs  inside  sample  length 
1  if  e  occurs  outside  sample  length 


P(missing  e)  = 


The  average  probability  of  recording  any  part  of  e  is 


P(recording  e)  =  ^ 


(7.2) 
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For  example,  if  L  -  100  seconds,  T  =  3  seconds  and  e  =  10 

seconds 

P(recording  e)  =  ^  ^  =  0.  15 

100 

This  might  appear  to  be  quite  low,  but  if  e  occurs  only  once,  it  might 
not  be  of  too  great  interest.  If  e  occurs,  for  example,  10  times  during 
a  1000  second  interval,  a  much  higher  probability  would  be  desired  and 
in  fact  does  exist.  Using  the  same  values  for  e,  T,  and  L  the  average 
recording  probability  is  now 

P(recording  e)  =  1  -^1  -  ^ =  0.  84 

A  more  pertinent  question  than  that  of  recording  any  part  of  e 
would  be;  "What  is  the  average  probability  of  recording  at  least  1  second 
of  a  10  second  event?"  Let  e^  be  the  minimum  portion  of  e  to  be 
recorded.  Then  Eq.(7.2)  becomes 

^(recording  at  least  *j.)  =  ^  ~  (7.3) 

If  the  probability  density  function  for  the  time  between  samples 
is  known,  then  a  confidence  interval  can  be  established  for  the  probability 
of  missing  e.  Assuming,  for  instance,  a  normal  (Gaussian) distribution 
for  L  with  mean  value  U  and  with  standard  deviation  a*,  the  proba¬ 
bility  of  missing  all  of  e  is  estimated  by 


(C  -  \o")  —  (T  t  e)  .  .  (L  +  Xo")  —  (T  e)  arm 

L  -  E  +  Xo“ 

where  X  is  the  number  of  standard  deviations  required  for  a  given 
confidence.  The  interval  for  the  probability  of  recording  any  part  of 
e  is 

^  <  P(recording  e)  <  ^  ^  ^  (7.5) 

L  +  Xo*  L  -  Xcr 


ASD  TDR  62-973 


7-7 


and  for  recording  at  least  a  portion  of  e  is 


T  +  (e  -  e^) 

— — - <  P(recording  at  least  e  )  < 

L  +  \o-  ^ 


T  +  (e  -  e  ) 
r 

L  -  \cr 


(7.6) 


For  example,  if  L  is  normally  distributed  with  17=  100  sec, 
O"  =  5  sec,  T  =  5  sec,  e  =  10  sec,  e^  =  1  sec,  and  \  =  2,  it  can  be 
said  with  95%  confidence  that  the  probability  of  recording  at  least  1 
second  of  the  event  e  falls  in  the  interval 


5  (10  -  1) 

100  +  10 


^  P(recording  at  least  e^)  < 


5  (10  -  1) 

100  -  10 


0.  127  <  P  <  0.  156 

The  above  equations  can  assist  in  determining  a  desirable 
sample  length  and  mean  time  between  samples.  Of  course,  judgment 
is  necessary  here  in  determining  how  long  an  unexpected  event  should 
be  to  be  considered  important,  and  what  is  the  permissible  miss  proba¬ 
bility.  Reference  1  jcontains  further  discussion  and  examples. 

Block  D  Number  of  Samples  to  Contain  Fraction  of  Population 

Another  criteria  to  help  determine  the  sample  length  and  mean 
time  between  samples  is  the  number  of  samples  required  to  predict  the 
total  (vibration)  life  history  from  these  samples,  namely  the  total  range 
of  possible  events. 

If  one  is  concerned  about  deviations  in  only  one  direction,  (i.  e.  , 
below  the  sample  maximum  value),  the  proportion  of  the  population 
occurring  below  the  maximum  sample  value  can  be  calculated  with  a 
known  confidence  from  the  equation,  see  Reference  A, 

(P)^  =  a  (7.7) 
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where 


P  =  proportion  of  population 
1  -  O'  =  confidence  coefficient 
N  -  sample  size 

If  deviations  in  both  directions  are  of  concern,  the  proportion  of  the 
population  occurring  within  the  maximum  and  minimum  sample  values 
is  given  by 


N-  1  N 

NP  -  (N  -  1)  P  =  o 


(7.8) 


where  N,  P  and  a  are  defined  as  above. 

Figure  7.3  gives  a  plot  of  Eq.(7 .7)  for  P  =  0.85,  0.90,  and  0.  95. 
This  curve  clearly  demonstrates,  that  for  P  =  0.  90,  very  little 
additional  confidence  would  be  gained  by  taking  a  continuous  record, 
no  matter  how  long,  rather  than  approximately  50  samples.  An 
assumption  made  here  is  that  the  population  is  infinite,  which  is 
generally  considered  valid  if  the  population  is  at  least  ten  times  as 
large  as  the  number  of  samples  taken.  Given  values  for  P  and  a, 

N  may  be  obtained  from  Figure  7.3.  For  example,  if  P  =  0.95  and 
(1  -  a)  =  0.  90,  then  N  =  45.  Conversely,  if  N  =  45  and  or  =  0.  10, 
then  P  =  0.  95. 

It  may  be  of  interest  to  know  the  probability  of  a  sample 
value  X  occurring  between  p,  i  Xo-  where  p  is  the  mean  value,  cr  is 
the  standard  deviation  of  the  population,  and  X  is  a  constant.  Making 
no  assumptions  about  the  population  distribution,  the  Tchebycheff  inequal¬ 
ity  may  be  applied.  This  gives 


Prob 


Xo~  <  X  <  p  +  Xcr 


>1 


(7.9) 


If  a  normal  (Gaussian)  distribution  exists, the  following  relation  holds 
which  yields  a  higher  probability  value,  namely,^ 
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SAMPLE  SIZE  N 


Ilf  \cr 


Prob 


\cr-<  X  <  +  ^^T- 


Xcr 


-v^ 


z  exp 


-(X  -  ti)^ 
20-2 


dx  (7.10) 


Thic  distribution  is  well  tabulated  and  widely  used. 

Table  7. 1  below  gives  a  comparison  of  probability  results  about 
the  sample  values  based  upon  the  Tchebycheff  inequality  and  the  assumption 
of  normality. 

Table  7.  1 


1 

2 

3 

Normal 

0. 6827 

0.  9545 

0.  9973 

Tchebycheff 

0 

0.  7500 

0.  8889 

P  rob  [  P  -  <  X  <  p  f  Xcr 


Block  E  Select  Over-all  Sampling  Scheme 

After  the  above  steps  have  been  accomplished,  an  over-all 
sampling  scheme  may  now  be  devised.  This  again,  will  require  some 
judgment  in  adjusting  the  sample  length,  mean  time  between  samples, 
and  number  of  samples  to  fit  together  as  a  meaningful  whole.  See 
Reference  ^  1  j  and  Section  8  here  for  detailed  examples  for  the  flight 
vehicle  vibration  situation. 


Block  F  Implement  Scheme;  Collect  Data 
Again  one  is  referred,  to  Reference 
of  the  problems,  such  as  instrumentation,  w 
implementation  of  a  random  sampling  scheme. 


for  a  discussion,  of  many 
hich  are  involved  in  final 


Block  G  Analyze  Data 

At  this  point  one  begins  the  analyses  presented  in  Reference 
and  in  other  parts  of  this  report. 
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7.3  PERIODIC  SAMPLING  OF  RANDOM  DATA 


If  data  is  assumed  or  verified  to  be  truly  random,  as  opposed  to 
being  periodic  or  even  containing  some  periodicities,  then  one  can  choose 
a  fixed  time  L  =  L  between  samples.  When  L  is  in  seconds,  the  period 
of  the  samplings  is  (1/L)  samples  per  second.  Now,  Eqs.  (7.4),  (7.5), 
and  (7 . 6)  have  O*  =  0 ,  and  Eqs .  (7.2)  and  (7 .  3)  with  L  =  L  state  the  prob¬ 
ability  of  recording  unexpected  events  for  periodic  sampling.  The 
validity  of  this  procedure  is  dependent  on  the  data  being  random.  If 
the  data  has  periodicities,  then  periodic  sampling  can  confuse  the  results 
through  aliasing  effects  wherein  high  frequencies  appear  as  low  frequencies. 

With  periodic  sampling,  rather  than  random  sampling,  it  is  easier 
to  detect  underlying  linear  trends  in  the  data  such  as  may  occur,  for 
example,  in  ballistic  missile  flights.  Once  detected  and  analyzed,  these 
trends  can  be  removed  so  that  further  analysis  can  be  devoted  to  the 
other  data  characteristics.  The  most  important  of  these  is  the  question  of 
stationarity  of  the  data. 

If  the  data  is  both  random  and  stationary,  then  the  data  can  be  collect¬ 
ed  at  arbitrary  random  starting  times,  and  sampled  periodically  thereafter, 
without  introducing  any  errors.  However,  if  the  data  is  nonstationary,  then 
results  are  dependent  upon  the  particular  times  of  observation  and  should 
be  analyzed  by  special  methods  as  discussed  in  Sections  2  through  6  of  this 
report.  For  nonstationary  data,  one  should  impose  a  fixed  starting  time 
requirement  and  express  the  results  as  a  function  of  this  starting  time. 
Whether  sampling  randomly  or  periodically,  Eqs.  (7.7)  and  (7.8)  which 
predict  the  range  of  expected  events  are  valid  only  when  the  data  is 
stationary . 

For  these  reasons  and  others,  it  is  clear  that  it  is  important  to 
verify  that  the  data  is  both  random  and  stationary.  Where  possible. 

Table  7.  1  shows  that  it  is  desirable  also  to  test  for  normality  so  as  to 
improve  the  statistical  confidence  about  the  range  of  sample  values. 
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UNCERTAINTIES  IN  ESTIMATED  PARAMETERS 


7.  4 

This  section  and  the  next  section  deal  with  the  problem  of 
coordinating  all  of  the  various  requirements  that  must  be  satisfied  in 
the  determination  of  the  length  T  of  each  of  the  samples.  The  reader 
will  note  that  sample  length  requirements  vary  widely  depending  on  which 
parameter  one  desires  to  estimate,  even  if  one  choses  the  same  confidence 
limits  throughout.  The  primary  purpose  in  designing  any  experiment  is  to 
obtain  the  "maximum”  amount  of  information  from  a  "minimum"  amount 
of  data.  The  "maximum"  amount  of  information  is  defined  here  as  that 
required  to  satisfy  a  predetermined  confidence  in  the  results.  The 
"minimum"  amount  of  data  is  interpreted  as  the  shortest  sample,  and 
the  least  number  of  samples,  needed  to  meet  the  predetermined  confidence, 
resulting  in  minimum  cost  and  manpower  expended. 

First,  a  brief  review  will  be  presented  of  the  various  formulas 
between  sample  length  and  the  associated  statistical  errors  for  each  of 
certain  desired  basic  parameters  to  be  estimated.  This  is  followed  by 
discussion  of  tests  for  fundamental  assumptions,  and  then  by  a  summary 
of  the  sample  length  relationships. 

7.4.1  Lowest  Frequency  of  Interest 

In  order  to  make  sure  that  the  lowest  frequency  of  interest  can  be 
detected,  at  least  one  full  cycle  of  this  frequency  has  to  be  recorded. 

Based  on  engineering  judgment  it  is  recommended  that  at  least  two  cycles 
be  recorded.  This  will  avoid  possible  loss  of  this  frequency,  in  case 
minor  variations  in  sample  length  occur.  In  equation  form 

T  =  -  (7.  1 

min 

where  f  is  the  minimum  frequency  of  interest. 

min 
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7.  4.  2  Mean  Square  Estimates 

When  estimating,  for  example,  the  mean-square  acceleration 
levels  during  a  flight,  the  confidence  in  the  measurements  can  be 
determined  from  knowledge  of  the  equivalent  number  of  statistical 
degrees  of  freedom  n 


n  =  2BT 


1 


Tj*  T 


where  B  is  the  bandwidth  in  terms  of  an  idealized  rectangular  filter, 
and  Tj  is  the  integrating  time(or  averaging  time)  of  an  ideal  integrator. 
It  should  be  noted  here  that  unless  the  filter  has  an  attenuation  of  at 
least  60  db  per  octave,  an  equivalent  noise  bandwidth  B^  has  to  be 
computed  for  B  in  Eq.  (7.  12).  See  Ref.  1,  p.  4-84  and  Section 
12.  3.  2  of  this  report. 

Equation  (7.  12)  shows  also  that  the  maximum  number  of 
degrees  of  freedom  for  a  sample  of  length  T  occurs  when  the  inte¬ 
gration  time  is  equal  to  T  .  This  in  turn  would  then  result  in 

the  maximum  statistical  confidence  that  can  be  obtained.  In  other 
words,  if  the  integration  time  Tj  is  less  than  the  sample  length  T  , 
the  number  of  degrees  of  freedom  is  determined  from  .  If  the 
integration  time  is  equal  to  or  greater  than  the  sample  length  T  ,  the 
number  of  degrees  of  freedom  is  limited  by  the  sample  length  T  . 
Using  an  averaging  time  that  is  longer  than  the  sample  will  therefore 
do  nothing  to  improve  the  statistical  accuracy  of  the  data,  but  will  only 
result  in  a  waste  of  time  and  effort. 

Now  consider  a  signal  with  a  Gaussian  distribution  and  a  true 

2 

mean  square  acceleration  of  o'  .  From  a  mean  square  measurement 
2 

of  s  from  a  sample  of  length  T  ,  a  confidence  interval  for  the  true 
mean  square  value  can  be  determined  based  on  a  knowledge  of  the 
number  of  degrees  of  freedom  n  ,  Ref.  ^1,  p.  7- 10  j  and  Section  13  of 
this  report. 


(7.  12) 
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A  limited  table  of  confidence  intervals  for  a  mean  square 
measurement  of  1. 0  as  a  function  of  the  degrees  of  freedom  is  presented 
in  Table  7.  2. 


Table  7.  2.  Confidence  Intervals  for  Mean  Square  Measurements 


To  illustrate  Table  7.  2,  assume  that  a  sample  is  two  seconds 

long  (T  =  2)  and  is  analyzed  using  an  ideal  filter  with  a  30  cps  bandwidth, 

and  with  a  true  integrator  having  an  integration  time  T,  of  two  seconds. 

^  2 

If  this  results  in  a  mean  square  acceleration  reading  of  10  g-  ,  one  can 
be  95%  confident  (see  Table  7.  2)  that  the  true  mean  square  acceleration 
in  the  aircraft  during  this  two-second  time  period  was  between  7.  9  and 
13.  1  g^,  since  n  =  2BTj  =  2  (30)(2)  =  120  (or  that  the  true  rms 
acceleration  was  approximately  between  2.  81  and  3.  62  g's).  It  should 
be  noted  that  in  order  to  obtain  the  overall  mean  square  value  of  a 
sample,  the  integration  time  T^  of  the  instrument  has  to  be  exactly 
equal  to  the  sample  length  T  . 

Often  RC  filters  are  used  to  perform  the  integration.  It  has  been 
shown  in  Ref.  1,  p.  7-12  that  this  results  in  a  different  number  of 
degrees  of  freedom,  namely 

n  =  4BK  (7.  13) 

where  K  =  RC  is  the  time  constant  of  the  integrator.  Now,  since  the 
output  voltage  of  an  RC  integrator  will  reach  the  input  voltage  after 
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approximately  4  time  constants  have  elapsed,  the  record  should  be  at 
least  4  times  as  long  as  the  time  constant  of  the  integrator.  For  a  two- 
second  sample,  this  would  require  a  time  constant  of  0.  5  seconds. 

Often  the  vibration  signal  is  recorded  on  magnetic  tape  which 
makes  it  possible  to  form  a  continuous  loop  for  each  sample.  In  this 
case  the  time  constant  of  the  RC  integrator  is  limited  only  by  Eq.  (7.  13). 

This  equation  limits  the  maximum  number  of  degrees  of  freedom  obtain¬ 
able  from  a  record  length  T  .  Combining  this  with  Eq.  (7.  12)  one 
finds 

K  =  jT  (7.  14) 

as  the  optimum  value  of  K.  Increasing  the  value  of  K  beyond  that 
indicated  by  Eq.  (7.  14)  will  do  nothing  to  improve  the  statistical 
quality  of  the  measurements. 

The  quality  of  the  estimate  can  also  be  expressed  in  terms  of 

2 

the  "standard  error"  t  or  normalized  variance  c  of  the  measurement 
as  follows: 

This  equation  is  useful  for  confidence  interval  estimation  if  it  can  be 

assumed  that  the  measurements  are  normally  distributed.  Also, it  is 

often  used  by  itself  as  a  measure  of  the  error  in  the  results.  The 

assumption  of  normality  is  a  good  approximation  if  the  number  of 

degrees  of  freedom  exceeds  120.  Then  the  square  root  of  «  =  Vl/BTj 

is  equal  to  one  standard  deviation  of  the  measurement  and  a  95% 

confidence  interval  is  given  by  s^  +  2c  .  For  example,  if  B  =  60  cps 

and  T,  =  T  =  5  seconds,  then  n  =  600  and  c  =V  1  /300  =  .058.  For  a 
^  2 

measurement  of  10  g  the  95%  confidence  interval  is  then  approximately 
9.  88  to  10.  12  g^. 
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7.  4,  3  Power  Spectral  Density  Estimates 


The  basic  measurement  performed  for  power  spectral  density 
analysis  is  the  mean  square  value  determination.  Therefore  the  same 
arguments  apply  here  as  those  developed  in  Section  7.  4.  2  above.  For 
example,  assume  a  sample  record  is  six  seconds  long  and  the  band¬ 
width  of  the  analyzer  filter  from  resolution  considerations  is  determined 
as  10  cps,  resulting  in  n  =  120  degrees  of  freedom.  The  maximum 
statistical  quality  attainable  in  the  power  spectrum  measurement  has 
now  been  fixed  by  Eq.  (7.  12).  Analysis  techniques  employed  from  this 
point  on  cannot  increase  the  statistical  accuracy  of  the  measurement 
beyond  that  defined  by  the  120  degrees  of  freedom.  However,  the 
statistical  accuracy  can  be  further  degraded  if  the  analyzer  filter  scans 
the  frequency  range  at  too  fast  a  rate.  This  problem  will  now  be  dis¬ 
cussed  for  constant  bandwidth  power  spectra  estimates  and  for  constant 
percentage  power  spectra  estimates. 


(a)  Constant  Bandwidth  Power  Spectra  Estimates 

From  Ref.  1,  p.  7-29j,  the  maximum  scan  rate,  (S.  R.),  below 
which  the  statistical  accuracy  will  not  be  affected  has  been  established 


as 


S.R. 


(7.  16) 


Another  problem  that  must  be  considered  is  the  transient  response  of  the 
analyzer  filter.  On  the  basis  of  proper  filter  response  the  scan  rate 
should  be  limited  to 

S.R.:=-|-  (7.17) 


If  an  RC  integrator  is  employed,  the  scan  rate  should  be  limited  to 


S.R. 


B 

4K 


(7.  18) 
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(b)  C  onstant  Percentage  Power  Spectra  Estimates 

For  constant  percentage  analysis,  the  analyzer  filter  bandwidth 

increases  in  direct  proportion  to  the  center  frequency  of  the  filter. 

Here  B  =  Pf  where  P  is  the  resolution  (some  constant  fraction  less 
c 

than  one)  and  f^  is  the  center  frequency.  For  constant  percentage 
analysis,  Eq,  (7.  12),  (7.  16),  (7.  17),  and  (7.  18)  become  respectively 


2  Pf  T, 
c  1 

(7. 19) 

Pf 

_  .j. 

(7.  20) 

1 

(Pfc)^ 

-  8 

(7.  21) 

Pf 

VI 

(7.  22) 

7.4.4  Probability  Density  Estimates 


The  uncertainty  for  probability  density  estimates  is  expressed 
in  terms  of  a  normalized  standard  error  £  .  Experimental  results  yield 
the  following  expression  (see  Section  14  of  this  report)  for  a  probability 
density  estimate  p  (x) 


€ 


4/2 


0.  07 


^x  p(x)  Uq  Tj 


(7.23) 


The  quantity  Axis  the  amplitude  window  width,  is  the  expected 
number  of  zero  crossings  per  unit  time,  and  T^  is  the  averaging  time. 
(This  is  usually  equal  to  the  record  length  T).  It  is  assumed  here  that 
the  bandwidth  B  is  not  narrow  with  B«  see  Section  14.  For  analog 
instruments  which  take  time  averages  by  smoothing  with  a  low  pass  RC 
filter,  Tj  =  2K  (for  T^'*=  T),  where  K  is  the  filter  RC  time  constant. 
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The  value  for  is  a  function  of  the  signal's  frequency- 
characteristics.  For  signals  having  a  uniform  power  spectrum  between 
two  effective  cutoff  frequencies  f^  and  f^,  the  term  is  given  by 


n  1/2 


a  b 


+  f. 


(7.  24) 


If  the  low  frequency  cutoff  is  at  f^  =  0  the  term  y ^  is  given  by 


y  =  15  f, 

^0  b 


(7.25) 


In  applying  Eq.  (7.  23)  for  cases  where  the  signal  is  a  repre¬ 
sentative  record  from  a  stationary  random  process,  confidence 
intervals  are  found  by  using  1  -f  Ve  jp(x)  where  \  is  a  normal  deviate 
(for  n>120).  For  example,  \  =  1  gives  a  68%  confidence  interval,  and 
\  =  2  gives  a  95%  confidence  interval.  For  n<120,  instead  of  ,  the 
t  statistic  should  be  used. 

Solving  Eq,  (7,  23)  for  T^,  gives  the  equation  for  the  required 
averaging  time  for  any  desired  standard  error  t  .  This  also  becomes 
the  expression  for  the  record  length  T  if  the  averaging  time  is  equal 
to  the  record  length,  namely 

2 


T  -  T^  = 


t  2ixp(x)2yo 
0~^7 


(7.26) 


Hypothetical  cases  based  on  Eq.  (7.  26)  appear  in  Section  14  of  this 
report.  These  cases  show  the  record  lengths  which  are  required  for 
typical  vibration  and  acoustics  problems.  For  example,  from  Table 
14.  1  2  in  Section  14,  one  sees  that  a  record  length  of  about  16  seconds 
would  be  required  to  obtain  estimates  with  e  =  0.  10  out  to  _+  3  rms, 
assuming  y  =  1000,  Ax  ^  0,  1,  and  p  (x)  follows  a  Gaussian  distribution 
with  an  rms  value  of  1,0. 

So  far  it  has  been  assumed  that  the  averaging  time  Tj^  is  equal 
to  the  record  length  T  .  In  reality,  sample  records  are  often  available, 
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which  are  longer  than  the  maximunn  averaging  time  of  the  analyzing 
instrument. 

If  the  analyzer  averages  by  linear  integration,  a  series  of 

estimates  will  be  obtained  over  a  single  record  length  T.  If  these 

estimates  are  then  averaged,  the  normalized  variance  of  this  average 
2 

will  be  equal  to  c  /N,  where  N  is  the  number  of  estimates  obtained 
from  a  single  record  T,  each  of  length  =  (T/N). 

If  the  analyzer  averages  with  a  low  pass  RC  filter,  the 
effective  averaging  time  is  equal  to  2K  (for  Tj'^T),  where  K  is 
the  time  constant  of  the  RC  filter. 

Many  probability  density  analyzers  estimate  p(x)  by  continuously 
sweeping  the  amplitude  window  Ax.  Here  the  Sweep  Rate  (S.R.  )  must 
be  slow  enough  to  permit  a  given  amplitude  level  to  be  viewed  by  Ax 
over  the  entire  averaging  period,  that  is 

S.R.i-^  (7.27) 

^  1 

If  this  condition  is  not  met,  the  uncertainty  of  the  estimates  will  be 
increased.  Specifically,  if  S.R.  is  greater  than  Ax/Tj,  the  effective 
record  length  will  be 


T 


eff  ~ 


Ax 

37R:. 


(7.28) 


Here,  if  an  RC  averager  is  employed,  the  scan  rate  should  be  limited 
to 


S.R.*-^  (7.29) 

7.  4.  5  Correlation  Function  Estimates 

Far  correlation  function  estimates,  the  normalized  mean  square 
error  is  also  a  function  of  the  ideal  bandwidth  B  and  the  record  length  T. 

The  exact  expression  for  this  mean  square  error  is  quite  complicated  and 
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is  also  a  function  of  the  signal  to  noise  ratio.  In  the  vicinity  of  R(0), 
approximately  up  to  the  first  zero  crossing,  the  mean  square  error  c 
is 


(7.30) 


(7.31) 

where  V.  ^  =  At/T  and  At  is  the  smallest  increment  in  t  to  be 
distinguished. 

7.5  TESTS  OF  FUNDAMENTAL  ASSUMPTIONS 

Statistical  tests  for  randomness  and  for  stationarity  are  in¬ 
vestigated  experimentally  in  Sections  15  and  16  of  this  report. 

Appropriate  theoretical  material  is  included  with  the  experimental 
results.  One  of  the  tests  for  randomness  and  one  of  the  tests  for 
stationarity  are  based  on  measurement  uncertainties  in  sample  mean 
square  values.  These  tests  are  as  follows. 

7.  5.  1  Test  for  Randomness 

Consider  a  sample  record  of  length  T  obtained  from  a 
vibration  response  x(t)  with  an  equivalent  ideal  bandwidth  B  .  Assume 
x(t)  is  stationary  over  the  sample  record  length  T  (to  be  verified  by 
other  procedures  discussed  in  Section  16),  and  that  x(t)  has  an 
approximately  Gaussian  amplitude  probability  density  function  with  a 
true  mean  square  value  of/)n.A/.  If  the  vibration  response  is  actually 


*  "“BT 

2 

At  R(0),  €  is  a  conservative  estimate  of  the  time  error  of  the 
correlation  function  estimate  and  this  error  becomes  progressively 
worse  as  the  time  difference  t  increases. 

If  T  is  varied  continuously  an  additional  error  is  introduced. 
This  is  given  by  Ref.  ^1,  p.  7-68j  for  large  BT  (say  BT^^lOO)  as 

«  \  BT 
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random,  a  mean  square  measured  value  x  from  the  sample  record 
will  have  a  sampling  distribution  with  a  variance  given  in  normalized 
terms  as  follows. 


c 


2 

o 


Var[ 
- 2“ 


X 


_  1 

^  BT  ’ 
a 


T  <  T 
a 


(7.32) 


vhere  T  =  averaging  time.  For  RC  averaging  with  time  constant  K, 

3i 

one  sets  T  =  2K  when  2K-==T,  and  T  =  T  when  2K=*‘T. 
a  a 

If  a  periodic  component  is  present  in  the  otherwise  random 
vibration  response,  the  normalized  variance  for  a  mean  square 
measurement  becomes 


where 


p  =  mean  square  value  for  periodic  portion 
r  =  mean  square  value  for  random  portion 
= /yYi^(per  iodic)  + /m.^(random)  =  p  +  r 


(7.33) 


From  Eq.  (7.  33),  the  variance  of  a  mean  square  measurement  will  be 

reduced  as  the  level  of  the  periodicity  is  increased  relative  to  the 

random  background  (as  p/r  increases).  This  relationship  lays  the 

groundwork  for  a  statistical  hypothesis  test  for  randomness.  _ 

2 

Assume  a  collection  of  N  independent  mean  square  values,  x^ 

(i  =  1,  2,  3,  ...  ,  N),  are  measured  from  a  stationary  vibration  response. 
This  collection  may  be  obtained  from  a  single  sample  record  by 
averaging  over  each  of  N  equally  long  segments  with  an  averaging  time 
T  =  (T/N).  The  variance  of  the  mean  square  measurements  can  be 

^  2  Z 

estimated  from  the  sample  variance  s  for  the  measured  values  x^  as 
follows. 
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2 

s 


N 


N 

E 

i=l 


X. 

1 


“Z  1 


N 


£ 


(7.34) 


Here,  x  is  the  mean  square  value  average  over  the  collection  length 

2 

T  5  NT  .  The  expected  values  for  the  sample  variance  s  and  the 

^  ~Z 

sample  mean  x  are  as  follows. 


E  s 


N-1 


N 


Var  x 


E  x 


(7.  35) 


Then,  the  normalized  variance  for  a  mean  square  measurement  may  be 
estimated  by 


2 

c 


(7.36) 


In  Eq,  (7.  36),  both  s  and  x  are  random  variables.  However,  it  is 

shown  in  Section  13  that  the  variability  of  x  is  negligible  compared  to 

2 

the  variability  of  s  if  the  quantity  2BT  40N  or  2BT  =*40.  If  this 

2  ^ 

requirement  is  met,  it  may  be  assumed  that  x  for  the  problem 

at  hand. 

2 

The  sample  variance  s  from  Eq.  (7.  36)  will  have  a  distribution 
associated  with  the  chi- squared  distribution  as  follows. 


_ ,7.3 

Var[x2]  N 

2 

where  means  "distributed  as",  and  x  is  a  chi- squared  distri¬ 

bution  with  (N-1)  degrees,  of  freedom.  From  the  relationships  in  Eq8.(7.  33) 
an.d  (7.  36),  it  follows  that 
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^  ^  (N-1)  . 

T"  N 


2BT  40 
a 


(7.38) 


From  Eq.  (7.  38),  the  following  probability  statement  may  be  made. 


Prob 


A  2 

e 


X  (N-l);(l-a) 

N 


=  (1  -a) 


where  a  is  the  level  of  significance,  and  (1-^)  is  the  confidence  level. 

Let  it  be  hypothesized  that  a  sampled  vibration  response  is 

2  2 

random.  If  this  is  true,  e  =  c  ,  and  the  hypothesis  H  is 


(7.39) 


(7.40) 


2  2 

If  a  periodic  component  is  present,  ^  will  be  equivalent  to  some  € 

2 

less  than  as  defined  in  Eq.  (7.33),  which  is  why  a  one-sided 

probability  statement  is  used  in  Eq.  (7.39).  Then,  Hq  may  be  tested  by 

computing's^  from  a  collection  of  mean  square  measurements,  computing 
2 

€  from  the  BT  product  for  the  measurements,  and  comparing  the  ratio 
©22  ^2 

of  'c  /s^  to  the  X  limit  in  Eq.  (7.  39)  at  any  desired  level  of  significance 
Q.  The  region  of  acceptance  for  is 


a2 

€ 


X  (N-l);{l-a) 
2  -  N 


(7.41) 


A  2  2 

If  e  /s  is  greater  than  the  above  noted  limit,  H  is  accepted  and  the 
o  2^2 

vibration  response  is  considered  random.  If  e  /  is  less  than  the 

noted  limit,  is  rejected  and  there  is  reason  to  suspect  that  a  periodic 

component  is  present  in  the  vibration  response.  The  appropriate  values 

in  Eq.  (7,  41)  for  any  desired  level  of  significance  can  be  obtained  from 

most  statistics  books. 

Further  discussion  of  this  test  for  randomness,  and  other  tests, 
appears  in  Section  15. 
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7.  5.  2  Test  for  Stationarity 

2 

Assume  a  collection  of  N  independent  mean  square  values,  , 

(i  =  1,  2,  3,  ,  N),  are  measured  from  a  random  vibration  response. 

This  collection  may  be  obtained  from  a  single  sample  record  by 
averaging  over  each  of  N  equally  long  segments  with  an  averaging 

time  T  -  (T/N).  If  the  vibration  response  is  stationary  with  a  mean 

^  2 
square  value  of  each  measurement  will  be  an  estimate  of 

and,  thus,  will  be  equivalent  to  one  another.  One  procedure  for 

testing  the  collection  of  measurements  for  equivalence  is  as  follows. 

This  procedure  is  identical  in  concept  to  the  statistical  test 

for  randomness  described  earlier.  If  the  vibration  response  is  random 

and  stationary,  the  mean  square  measurement  x.  will  have  a  sampling 

2  ^ 

distribution  with  a  normalized  variance  of  £  ,  as  defined  in  Eq.  (7.  32). 

o 

For  a  collection  of  N  mean  square  measurements,  the  actual  normalized 
2  /\2 

variance  €  may  be  estimated  by  €  ,  as  defined  in  Eqs.  (7.  34)  and  (7.  36). 
2  2 

The  ratio  of  ^  /«  will  be  distributed  as  shown  in  Eq.  (7,  38). 

The  following  probability  statement  may  be  made. 


Prob 


^  (N-l);a 
N 


=  (1-Qf) 


(7.  42) 


Let  it  be  hypothesized  that  a  sampled  random  vibration  response 

2  2 

is  stationary.  If  this  is  true,  «  =  ,  and  the  hypothesis  is 


H, 


(7.43) 


^2 

If  the  vibration  response  is  nonstationary,  €  will  be  equivalent  to 
2  2 

some  undefined  c  greater  than  ,  which  is  why  a  one-sided  (upper 

tail)  probability  statement  is  used  in  Eq.  (7.  42).  Then,  Hq  may  be 

tested  by  computing  €  ^  from  a  collection  of  mean  square  measurements, 
2 

computing  e  from  the  BT  product  for  the  measurements,  and  com- 
o  A.  Z  2  ^  Z 

paring  the  ratio  of  «  /«^  to  the  x  limit  in  Eq.  (7.  42)  at  any  desired 
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level  of  significance  a.  The  region  of  acceptance  for  Hg  is 


a2 


2 

t 


(N-l);a 

N 


(7.44) 


o 

A  Z  2 

If  €  /«  is  less  than  the  above  noted  limit  is  accepted  and  the 

^  ^22 
vibration  response  is  considered  stationary.  If  ^  is  greater  than 

the  noted  limit,  Hg  is  rejected  and  there  is  reason  to  suspect  that  the 

vibration  response  is  nonstationary. 


Further  discussion  of  this  test  for  stationarity ,  and  other  tests, 
appears  in  Section  16. 

It  IS  clear  that  the  above  test  can  be  combined  with  the  test  for 

2 

randomness  discussed  in  Section  15,  by  using  a  two-sided  x  test.  If 
it  is  hypothesized  that  the  vibration  response  is  random  and  stationary, 
the  region  of  acceptance  for  the  double  hypothesis  Hg  is 


2  ^2 

^(N-l);(l-a/2)  2  (N-l);a/2  _  ^ 

- S  7  S  -  ('  •'3 

N  €  ^  N 

o 

In  Eq.  (7.  45),  since  (a/2)  replaces  a,  the  lower  limit  is  less  than  the 
limit  for  the  randomness  test  alone,  as  given  in  Eq.  (7.  41).  Similarly, 
the  upper  limit  is  higher  than  the  limit  for  the  stationary  test  alone,  as 
given  in  Eq.  (7.  44).  Thus,  a  test  of  the  double  hypothesis  will  involve  a 
wider  region  of  acceptance  for  a  given  confidence  level  (1  -  a).  To 
maintain  a  desired  Type  II  error,  more  measurements  are  required  for 
the  combined  test  than  for  each  individual  test. 


7.  5.  3  Test  for  Normality 

Section  17  of  this  report  contains  results  from  an  experimental 
study  which  develops  a  test  for  normality  based  on  expected  measure¬ 
ment  uncertainties  in  amplitude  probability  density  estimates. 
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7.  6  SAMPLE  LENGTH  DETERMINATION 


From  the  results  of  Section  7.  4  and  7.  5,  one  can  see  that  there  are 
five  basic  parameters  and  three  tests  of  fundamental  assumptions  that 
involve  the  sample  length.  These  are  listed  below  in  order  of  increasing 
sample  length  usually  required  for  a  given  mean  square  error  or 
confidence  in  the  results. 

Parameters: 

1)  Lowest  Frequency  of  Interest 

2)  Mean  Square  Value 

3)  Correlation  Function 

4)  Power  Spectral  Density 

5)  Amplitude  Probability  Density 

Tests  of  Assumptions: 

1)  Randomness 

2)  Stationarity 

3)  Normality 

Qualitative  reasons  for  stating  that  the  necessary  sample  length 
T  increases  in  going  from  parameter  (1)  to  parameter  (5)  are  as 
follows.  The  lowest  frequency  of  interest  gives  a  bound  for  T  which  is 
not  dependent  upon  a  measurement  error  e  .  However,  in  order  to 
reduce  a  mean  square  value  measurement  error,  one  must  increase  T 
appropriately.  Uncertainties  in  mean  square  measurements  and 
correlation  function  measurements  have  the  same  error  formula  for 
the  maximum  point  of  the  correlation  function  at  zero  delay.  This  is  not 
true  for  non-zero  correlation  delays.  For  these  correlation  points,  T 
must  be  increased  to  maintain  the  same  error.  Next,  bandwidths  used 
for  power  spectral  density  function  measurements  are  generally  smaller 
than  for  mean  square  value  measurements  since  one  desires  to  resolve 
sharp  spectral  peaks.  To  maintain  a  given  error,  these  bandwidth 
reductions  must  be  compensated  for  by  longer  record  lengths.  Finally, 
amplitude  probability  density  estimates  require  the  longest  sample 
lengths  because  one  desires  to  measure  these  probability  density  func¬ 
tions  out  to  values  of  extreme  amplitudes. 
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In  order  to  arrive  at  the  minimum  sample  length,  based  on  some 
predetermined  maximum  allowable  error,  the  following  steps  should 
be  considered. 

Step  1.  Since  the  estimation  of  the  vibration  environment  is  of 

primary  importance,  the  sample  length  should  always  be  based  on  a 

minimum  acceptable  mean  square  error  for  any  of  the  four  statistical 

parameters  desired.  (Note  that  f  is  not  a  "statistical"  parameter.  ) 

min 

Using  this  sample  length,  one  can  then  determine  the  confidence  in  the 
tests  of  fundamental  assumptions. 

Step  Z.  All  instrumentation  that  will  be  used  in  the  estimation 
of  the  various  parameters  should  have  an  ideal  averaging  time  equal  to 
or  greater  than  the  sample  length  determined  from  the  appropriate 
equations.  If  the  ideal  averaging  time  is  less  than  the  sample  length, 
the  error  will  increase  and  the  confidence  will  decrease  in  the  results. 

If  RC  averaging  is  employed,  the  minimum  time  constant  K  =  RC  should 
satisfy 

K  »  j  T  (7. 14) 

Step  3.  No  matter  which  parameters  are  to  be  estimated, 

Eq.  (7.  11)  should  be  used  as  a  check  to  determine  if  the  requirement 
for  the  lowest  frequency  of  interest  can  be  met,  namely, 

T  >  -i—  (7. 11) 

f 

min 

For  example,  if  f  =2  cps,  then  T  should  be  —  1  second. 

^  min 
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step  4.  If  the  amplitude  probability  density  is  one  of  the 
parameters  to  be  estimated,  the  sample  length  should  be  determined 
from  Eq  (7.  26),  It  will  usually  result  in  the  longest  sample  for  any 
given  mean  square  error  as  compared  to  the  other  parameters. 


T  = 


Akp{k)Uq 

0.  07 


(7.26) 


If  the  amplitude  window  Ax  is  swept  continuously,  the  maximum 
allowable  sweep  rate  that  can  be  used,  without  increasing  the  error 
decided  upon  should  be  calculated  from  the  appropriate  Eqs.  (7.27)  or 
(7.29). 


Step  5.  If  the  amplitude  probability  density  is  not  required,  the 
power  spectral  density  will  now  usually  govern  the  sample  length 
which  should  be  determined  from  Eq.  (7.  15).  By  solving  for  T, 
one  obtains 

T  =  — ^  (7.46) 

In  order  not  to  increase  the  error  decided  upon,  the  maximum  allowable 
sweep  rates  should  be  calculated  from  the  appropriate  Eqs.  (7.16), 

(7.17),  or  (7.18). 

Step  6.  If  only  correlation  functions  and/or  mean  square  values 
are  desired,  Eq.  (7.  46)  can  again  be  used  for  sample  length  deter¬ 
mination. 

For  correlation  function  estimates,  one  also  has  to  consider  the 
rate  of  change  of  t.  The  maximum  allowable  sweep  rate  should  be 
calculated  from  the  appropriate  Eq.  (7.  31). 
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7.  7  STATISTICAL  EVALUATION  OF  DATA 
FROM  SINGLE  EXPERIMENT 


When  the  sample  length  has  been  decided  upon,  one  has  to 
determine  the  effect  of  the  number  of  samples  on  the  over-all  confidence 
of  the  experiment.  The  "experiment"  might  be  the  measurement  of 
vibration  levels  at  a  particular  point  during  a  certain  flight  phase  or 
during  the  whole  flight. 

By  sample  size  will  be  meant  here  the  number,  N,  of  samples 
to  be  obtained  in  any  one  experiment.  The  term  number  of  experiments 
will  denote  the  number  k  of  repetitions  of  a  particular  experiment 
(e.  g.  ,  the  number  of  flights)  in  each  of  which  N  samples  are  taken. 
Altogether,  there  would  be  Nk  samples.  It  is  important  to  select  N 
and  k,  if  possible,  so  that  one  can  make  good  statistical  predictions 
both  with  data  from  within  a  single  experiment,  as  well  as  with  data 
from  experiment  to  experiment.  If  N  and  k  are  merely  given  values, 
and  not  at  one's  choosing,  then  it  is  important  to  be  able  to  calculate 
the  statistical  accuracy  to  be  attached  to  predictions  based  on  the 
given  values. 

Estimates  of  a  true  population  mean  p  and  a  true  population 

variance  cr  as  calculated  from  a  sample  of  size  N  will  be  denoted 

_  2  -  2 

by  X  and  s  ,  respectively.  The  estimate's  x  and  s  will  be 

random  variables,  differing  for  each  sample  of  size  N,  while  the  true 

values  p  and  cr^  are  constants.  The  standard  deviation  cr  is,  of 

course,  the  positive  square  root  of  the  variance. 

The  discussion  in  this  section  is  devoted  to  the  case  of  a  single 
experiment  for  which  k  =  1.  Cases  of  multiple  experiments  (e.  g.  , 
simultaneous  data  from  many  points  or  from  many  flights)  are 
analyzed  in  Section  8. 
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7.7,1  Case  1 :  No  consideration  of  uncertainty  in  measured  sample  values. 


Suppose  N  independent  parameter  estimates  (e.g.  ,  mean  square 
values) ,  denoted  ,  j  =  1 , 2 ,  .  .  .  ,N ,  are  obtained  in  a  single  experiment, 

and  suppose  the  statistical  uncertainly  in  each  sample  value  is  unknown  or 
ignored.  The  first  problem  is  to  obtain  estimates  of  the  sample  mean  and 
sample  variance  to  be  associated  with  the  N  parameter  values  from  this 
single  experiment. 

By  definition,  the  sample  mean  is  obtained  by  calculating 


x=JlL__  (7.47) 

N 


and  the  sample  variance,  that  is,  the  mean  square  value  about  the  mean 
value,  by  n  ^ 


(.j  -  X) 


2  j  =  l 

s  =  —d - 


N 


(7.48) 


One  can  now  show  that  the  expected  value  of  x  is 


E(x)  =  p 


(7.49) 


and  the  expected  value  of  s^  is 


2.  /  N  -  1  \  2 

E(s  )  =( - -  cr 


(7,50) 


where  p  and  cr  are  the  true  population  mean  and  variance,  respectively. 
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A  block  diagram  for  analyzing  a  set  of  parameter  values  from  a 
single  experiment  is  drawn  in  Figure  7.4.  The  various  confidence  intervals 
and  tolerance  intervals  in  Fig  -  7.4  can  be  determined  in  parallel  as  shown. 


Figure  7 . 4.  Recommended  Procedure  for  Analyzing  a 
Set  of  Values  from  a  Single  Experiment 


Confidence  Interval  for  Population  Mean 

If  the  N  parameter  values  are  assumed  to  originate  from  anunder- 
lying  normally  distributed  population  (a  hypothesis  which  can  be  tested 
by  statistical  methods  discussed  in  Reference [^1^  .  then  a  confidence 
intervcd  can  be  formed  around  the  sample  mean  value  x  so  as  to  contain 
the  true  population  mean  value  p  within  any  desired  level  of  significance 
a.  The  interpretation  of  confidence  is  that  if  the  experiment  of  esti¬ 
mating  X  and  8  from  N  sample  values  is  repeated  many  times, 
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then  the  probability  is  ( 1  “  o)  that  the  true  mean  p  will  lie  in  the  interval 
bounded  by  x  +  ^(o/2)  ®/VN“  1  ,  that  is 


P.rob 


+ W2)  ;7= 


(1  -  a) 

(7.51) 


where  a  is  some  desired  proportion  (0<  o<  1)  and  taken 

from  the  tables  of  the  t  distribution  with  (N  -  1)  degrees  of  freedom 
at  the  (ar/2)  percent  value. 

For  example,  assume  a  =  .  05  and  a  sample  of  size  N  =  6  with 
X  =  12.  3  and  s  =  2.  19.  In  the  tables  of  the  t-distribution  one  finds  for 
5  degrees  of  freedom  t^  ^=2.57.  Using  Eq.  (7.51), 


Prob 


12.  3  -  (2.  57) 


p<12.  3  +  (2.  57) 

Vs 


2.  19 

V^ 


-  .95 


=  Prob 


9.8<p<  14.8 


=  .95 


Confidence  Interval  for  Population  Variance 

A  confidence  interval  may  also  be  computed  around  the  sample 

2  2 
variance  s  so  as  to  contain  the  true  population  variance  cr  within 

any  desired  level  of  significance  a.  This  is  given  by 


Prob 


Ns 


(a/2) 


<  <r  < 


Ns 


l-(a/2) 


=  (1  -  a) 


(7.52) 


2  2 

where  is  taken  from  tables  of  the  distribution  with  (N  -  1) 

degrees  ol  freedom  at  the  p  percent  value.  Above,  p  =  (ff/2)  and 
1  -  (a/2). 


ASD  TDR  62-973 


7-33 


As  an  example,  assume  the  same  sample  values  as  above,  Then 
from  Eq.  (7 . 52) , 


Prob 


6(4.80)  ^2  ^  6(4.80) 

12.8  ~  ~  0.4 


.95 


=  Prob 


2.2<cr  <  67.0 


.  95 


where  5  =  12.8  and  ^  =  0.  4  are  found  from  a  table  of 

with  5  degrees  of  freedom. 


Large  Sample  Size 

For  large  values  of  N,  say  N>30,  confidence  intervals  for  p 
and  a~  can  be  approximated  closely  using  tables  of  the  normal  distri¬ 
bution.  The  results  for  large  N  are 


Prob 


\ 

a 


+ 


X, 

a 


Vn 


(7.53) 


Prob 


s 


X  —  -  C  Q-  <  B  +  X  - 


(1  -  a)  (7.54) 


where  X^  is  the  o*  percent  value  of  the  normal  distribution,  as  defined 
by  considering  deviations  in  both  directions  from  the  mean  value.  The 
previous  percent  values  for  the  t  and  distributions  considered 

deviations  only  xn  one  direction. 

Assume  x  =  12.  3  and  s  =  2.  19  but  with  a  sample  size  N  =  36. 
Then  for  or  =  .  05,  ^  05  “  found  from  a  table  of  the  normal 

distribution.  Using  Eq.  (7.53) 


Prob 


12.  3  -(1..96).-^^  <p<  12.  3+  (1..96).i^ 
V  36  -y/lb 


=  .95 


[u. 


=  Prob  11.6^p<13.0 


=  .95 
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and  from  Eq.  (7.54), 


Prob 


2.  19  -  (1.96)-^4^<cr<2.  19  +(1.96) 


=  .95 


=  Prob 


1.  7S(r^2.  7 


=  .  95 


Tolerance  Intervals 

A  tolerance  interval  around  a  sample  mean  value  3C  ,  calculated 
from  a  sample  of  size  N,  is  defined  as  an  interval  that  will  contain  at 
least  a  proportion  ( 1  -  o)  of  the  underlying  population  a  desired  percentage 
P  of  the  time.  This  percentage  P  is  called  a  confidence  coefficient. 

The  tolerance  interval  is  bounded  by  the  values 

x+Ks  (7.55) 

where  K  is  a  numerical  coefficient  depending  upon  N,  or,  and  P,  which 
is  tabulated  in  Ref.  j^l"]  . 

For  example,  assuming  an  underlying  normal  distribution,  for  a 
sample  of  size  100,  the  tolerance  interval  that  will  contain  at  least  90% 
of  the  population  with  95%  confidence  is  given  by 

X  +  1.87  s 

Considered  another  way,  the  above  example  states  that  the  probability  is 
0.  95  that  at  least  90%  of  all  population  values  will  lie  in  the  interval 
shown. 

If  the  true  population  mean,  p,  and  true  standard  deviation,  <r, 
were  known  precisely,  then  regardless  of  the  size  of  N,  there  is  100% 
confidence  that  at  least  a  proportion  (1  ~  a)  of  the  population  lies  inside 
the  interval 


p  +  X  o" 
-  a 


(7.56) 
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Nn^here  X  is  the  a-percent  value  of  the  normal  distribution.  For  example, 
a 

100%  confidence  exists  that  at  least  95.  5%  of  the  population  will  lie  inside 
the  interval  p  -I-  2o~.  On  the  other  hand,  for  K  =  2.0,  only  75%  confidence 
exists  that  at  least  90%  of  the  population  lies  inside  the  interval  x  +  2s, 
if  3c  and  a  are  calculated  from  15  samples. 

For  large  N,  where  p  and  a-  are  approximated  closely  by  x 
and  s  ,  the  coefficient  K  approaches  the  normal  a-percent  value  and 
the  confidence  coefficient  P  approaches  100%.  In  the  previous  example, 
where  K  =  2.0,  there  is  90%  confidence  that  at  least  90%  of  the  popula¬ 
tion,  based  on  calculating  x  and  s  from  33  samples,  lie  inside  the 
interval  Sc  2s:  there  is  95%  confidence  that  at  least  90%  of  the  population 
using  50  samples  lie  inside  this  same  interval  and  99%  confidence  for  at 
least  90%  of  the  population  using  90  sannples. 

The  main  point  of  this  discussion  is  that,  for  a  proportion 
(1  -  a)  =  0.90  and  a  constant  K  =  2.  0,  little  increased  confidence  (i.e., 
higher  P)  is  gained  by  choosing  N  larger  than,  say,  N  =  50.  In  the 
example  above,  changing  N  from  50  to  90  increased  the  confidence  only 
from  95%  to  99%  that  at  least  90%  of  the  population  would  fall  in  the 
interval  Sf  +  2s. 


7.7.2  Case  2.  Consideration  of  uncertainty  in  measured  sample  values. 


Suppose  N  independent  parameter  values,  denoted  by  Xj  , 
j  =  1,  2,  .  .  .  ,  N  are  obtained  in  a  single  experiment.  Suppose  also  that  the 
variance  associated  with  each  of  these  values  is  estimated  to  be  s.^, 

2  J 

where  s.  are  assumed  to  be  the  same  from  experiment  to  experiment. 

J  2 

None  of  the  s.  are  permitted  to  be  zero.  How  should  the  sample  mean 
J 

and  sample  variance  be  calculated  now  for  the  N  parameter  values  of 
the  experiment? 

For  this  situation,  define  the  sample  mean  by 


■t 


(7.57) 


where 


(7.58) 
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Define  the  sample  variance  for  the  N  values  by 


2  2  i 

s  =  N  A 

h  >  > 


N 


(7.59) 


d/.j') 


J= 


coefficients 


Since  s.^  is  an  estimate  of  the  true  variance  $  the 
J  J 


a  2 


(7.60) 


To  allow  Eq.(7.  60)to  replace  Eq47.  58)  would  require  prior  information 
of  the  true  variances  cr^  ,  usually  not  known. 

J  2  2 

In  view  of  the  assumption,  that  s.  is  a  fixed  estimate  of  or 

J  J 

from  experiment  to  experiment,  the  coefficients  a.  are  constants 'from 

J 

N 

experiment  to  experiment.  Now,  from  the  fact  that  T.  a.  s  1,  it  follows 
that  the  expected  value  of  the  sample  mean  is 


E(*)  =  ,  a.  E(,j)  =  ^  aj  = 


(7.61) 


and  the  expected  value  of  the  sample  variance  is 

N 


E(.")  .  N  J  a/  E(x.^)  =  N  ^  aj2  c-‘ 


(7.62) 


If  s.  equals  the  same  value  for  all  j,  then  a.  =  (1/N)  for 
J  J 

lallj.  For  this  special  situation, 

N 


with  E(X)  =  p 


(7.63) 


2  1 
“  = -FT 
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E(s^)  = 


(7.64) 


2  2 

when  (T  =  E{Sj  )  is  assumed  to  be  the  same  for  all  j. 

The  remainder  of  the  analysis  for  Case  2  now  proceeds  as  in 
2 

Case  1,  with  x  and  s  defined  by  Eqs.  (7.  57)  and  (7.  59)  instead  of 

by  Eqs.  (7.  47)  and  (7.  48).  For  example,  if  N  =  2,  with  x,  =  16, 

2  2  ^ 

=  20,  and  s^  =1,  82=  3,  one  calculates  a^  =  (3/4),  a2  =  (1/4). 

Then  'R  =  17  and  s^  =  1.  5. 


7.  8  STATISTICAL  EVALUATION  OF  DATA  FROM  MANY 
EXPERIMENTS 

The  most  useful  statistical  analysis  for  evaluating  a  collection  of 
experiments  comes  under  the  general  heading  of  "analysis  of  variance.  " 
The  object  of  this  analysis  is  to  test  the  hypothesis  that  the  mean  values 
of  some  particular  parameter  from  experiment  to  experiment  are  not 
significantly  different.  If  this  hypothesis  can  be  verified,  the  results 
of  the  several  experiments  may  be  combined.  Then,  the  resulting 
large  sample  size  may  be  used  for  more  precise  estimates  of  the 
parameters  of  interest.  One  has  thus  simultaneously  verified  an 
important  assumption  and  has  a  large  amount  of  data  for  parameter 
e  stimation 

For  instance,  in  the  case  of  vibration  in  a  flight  vehicle,  one  may 
take  a  large  amount  of  data  from  a  single  flight  and  make  precise 
estimates  of  parameters  for  that  single  flight.  However,  it  is  obviously 
of  value  to  be  able  to  use  the  results  to  make  predictions  to  other 
flights  conducted  under  similar  conditions.  Clearly,  one  is  on  some¬ 
what  tenuous  grounds  making  predictions  to  other  flights  no  matter  how 
large  the  sample  from  the  single  flight.  However,  when  some  con¬ 
sistency  from  flight  to  flight  has  been  verified,  predictions  may  be 
made  to  other  similar  flights  with  much  greater  confidence. 

These  matters  are  discussed  in  the  next  Section  8  of  this 
report. 
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8.  ANALYSIS  OF  VARIANCE  PROCEDURES  FOR  EVALUATING 
VIBRATION  DATA  FROM  MANY  POINTS 

8.  1  INTRODUCTION 

In  the  prediction  of  the  over-all  vibration  life  history  of  flight  vehicles, 
analysis  of  variance  techniques  can  be  employed  to  determine  if  significant 
differences  between  vibration  measurements  exist,  and,  if  they  do  exist, 
the  magnitude  of  the  variance  of  these  measurements  can  be  estimated. 

The  general  hypothetical  problem  is  as  follows.  Samples,  each  of 
the  same  length,  are  taken  at  random  for  the  entire  flight  of  a  given  flight 
vehicle  at  several  points  within  each  flight  vehicle.  These  measurements 
are  then  repeated  for  several  flights  of  the  same  flight  vehicle  or  for  other 
flight  vehicles  of  the  same  general  class  (i.  e.  ,  B-52's,  F-105's,  etc.  ). 
Before  the  complete  set  of  vibration  measurements  can  be  pooled  to  predict 
the  over-all  vibration  environment,  it  has  to  be  determined  if  these 
measurements  are  statistically  equivalent.  Specifically,  the  vibration 
engineer  has  to  know:  (i)  are  all  the  measurements  within  each  flight  at  one 
particular  point  equivalent;  (2)  are  the  measurements  between  the  various 
points  within  each  flight  vehicle  equivalent,  and  (3)  are  the  measurements 
from  flight  to  flight  equivalent. 

If  the  measurement. s  within  each  flight  are  not  equivalent,  the  data 
can  be  said  to  be  "nonstationary.  "  One  solution  would  then  be  to  break  up 
each  flight  into  various  flight  phases,  within  which  the  measurements  are 
equivalent,  i.  e.  ,  within  which  the  environment  is  "stationary.  "  If  the 
measurements  between  the  various  points  are  not  equivalent,  a  separate 
prediction  will  have  to  be  made  for  each  of  the  points. 

Finally,  if  the  measurements  from  flight  to  flight  are  not  statistically 
equivalent,  the  data  cannot  be  pooled,  and  an  over -all  prediction  cannot  be 
made.  The  vibration  engineer  will  then  have  to  look  for  the  physical  cause 
of  these  differences  and  may  have  to  design  a  new  experiment.  For  example, 
assume  that  four  flights  were  made,  and  one  particular  flight  shows  a  con¬ 
siderably  higher  vibration  environment  than  the  other  three  and  an  analysis 
of  variance  indicates  a  significant  difference  between  flights.  If  the 
vibration  engineer  decides  that  the  higher  vibration  levels  were  due  to  bad 
weather  during  the  one  flight,  possibly  the  new  experiment  should  consist 
of  more  flights,  several  of  which  should  be  made  during  the  bad  weather,  so 
that  a  more  representative  sample  is  obtained. 
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It  is  realized  that  time  and  money  may  make  it  difficult  to  repeat 
such  a  program  and,  therefore,  the  engineer  should  do  his  best  to  obtain 
a  representative  sampling  on  the  first  go-around.  The  analysis  of 
variance  cannot  help  the  engineer  in  many  aspects  of  the  experimental 
design.  However,  it  can  be  of  considerable  assistance  in  indicating 
proper  methods  of  data  collection  such  that  the  maxurnum  information  may 
be  obtained  from  the  minimum  amount  of  data, 

Another  possible  use  for  the  analysis  of  variance  techniques  is  to 
determine  if  a  single  vibration  specification  could  be  written  for  a  general 
type  of  aircraft  (e.  g,  .all  fighters,  or  all  bombers,  etc.  ).  If  data  is 
available  for  a  number  of  different  .aircraft,  all  of  one  type,  this  data  can 
then  be  tested  to  determine  if  it  is  statistically  equivalent. 

The  following  sections  will  describe  the.  simpler  analysis  of  variance 
techniques  that  can  be  employed  to  arrive  at  the  appropriate  decisions. 

The  primary  portion  of  this  discussion  has  been  taken  from  a  book  by 
A.  H.  Bowker  and  G.  J.  Lieberman  entitled  "Engineering  Statistics,  " 
published  by  Prentice  Hall  in  May  1961.  For  additional  information,  the 
reader  is  referred  to  this  text.  Ref  [  •-  ]• 

The  subsequent  discussion  for  the  one-way  analysis  of  variance  is 
for  a  large  part  a  repetition  of  a  portion  of  Section  5.  4,  "Statistical 
Results  from  Repeated  Experiments",  of  Ref.  1  .  The  subject  is 
directly  extended  here  to  the  more  complicated  two-way  analysis  of 
various  procedures.  Also,  the  two  different  interpretations  of  the  analysis 
of  variance  procedures  are  presented  here  which  were  ignored  in 
Ref.  ^  1  j  in  the  interest  of  simplicity.  The  discussion  in  Ref.  1  corres¬ 
ponds  to  the  random-effects  model  (model  II)  one-way  analysis  described 
here. 

The  repetition  of  material  in  Ref.  1  is  given  in  the  interest  of 
completeness,  and  also  for  the  introduction  of  different  notation  and  com¬ 
puting  procedures  which  are  highly  useful  in  extending  to  two-way  (and 
higher)  analyses.  At  certain  points  in  this  section,  the  notation  will  be 
reconciled  with  that  of  Ref.  ^  2  j  in  order  that  one  may  cross  reference 
with  a  minimum  of  confusion. 

The  material  here  does  not  teli  one  how  to  go  about  interpreting  the 
data  if  the  analysis  indicates  pooling  may  be  allowed.  However,  this 
subject  is  discussed  in  some  detail  in  Ref.  ^  1  j  and  the  reader  may  refer 
to  that  report  for  extensions  in  that  direction. 
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ONE-WAY  ANALYSIS  OF  VARIANCE 


8.  2 

Before  any  predictions  can  be  made,  the  vibration  engineer  has  to 
determine  whether  or  not  the  various  flights  are  statistically  equivalent. 
For  this  purpose  alone,  a  one-way  analysis  of  variance  may  be  used. 

Since  measurements  may  be  taken  at  more  than  one  location  within  each 
flight  vehicle,  this  procedure  should  be  applied  separately  to  each  of  the 
points.  For  the  measurements  at  one  point  only,  if  one  desires  to  make 
a  decision  about  the  within  flight  and  between  flight  measurements  simul¬ 
taneously,  then  the  two-way  analysis  of  variance  procedure  discussed  in 
Section  8.  3  should  be  used. 

8.  2.  1  Mathematical  Models 

For  one  particular  point  on  the  structure,  let  be  the  jth 

measurement  for  the  ith  flight.  It  should  be  noted  that  x  represents 
one  sample.  It  could  be  the  mean  square  acceleration  for  one  sample,  or 
the  rms  acceleration,  or  represent  velocity,  displacement,  stress,  or 
any  other  unit  of  measurement. 

(a)  Fixed  Effects  Model 

This  mathematical  model  is  written  as 


X.  . 


=  4-  +  ^ 

1  ij 


(8.  I) 


where  is  the  fixed  effect  due  to  the  ith  flight  and  is  a  random 
effect  assumed  to  be  independently  normally  distributed  with  mean  zero 
and  variance  cr^  . 

^  can  be  further  subdivided  into  C  where  C  is  a  component 

common  to  all  flights  and  is  a  fixed  effect  peculiar  only  to  ith  flight. 
The  dot  (.  )  in  place  of  a  subscript  indicates  averaging  over  that  subscript. 
This  subdivision  is  accomplished  by  defining  C  as  the  average  of  all 
the  C.  •  i-  e.  , 

^  r 

i=l 


(8.2) 


r 
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and  defining  as  the  deviation  of  the  4^  from  the  average,  i.  e.  , 

9,  =-•  ^  -  4  (8.  3) 

r 

Thus,  0  has  the  property  /  0=0.  The  x  ,  can  then  be  written  as 

x.  =  4+  0+  ^.’  (8.4) 

ij  •  ^1  ij 

where  x  .  is  assumed  to  be  normally  distributed  with  mean  C  +9 
ij  2  ■  ^ 

and  variance  cr 

The  purpose  here  is  to  draw  some  conclusions  about  whether  the 

flights  are  equivalent.  This  is  the  same  as  making  statements  about  the 

equ.ality  of  the  0_.  If  the  0.  are  equal,  they  all  must  be  equal  to  zero. 

This  model  is  called  the  "fixed  effects"  model  because  the  0  are  fixed 

^1 

effects  and  conclusions  derived  from  the  experiment  will  apply  only  to 
the  flights  made.  Conclusions  about  other  flights  cannot  be  made  with 
the  interpretation  affo.rded  by  this  model. 

(b)  Random  Effects  Model 

If  it  is  desired  to  extend  the  conclusions  to  other  flights  (which 
13  usually  the  case)  a  "random  effects"  model  has  to  be  used.  Here  the 
experimenter  has  to  make  sure  that  the  flights  during  which  he  takes 
measurements  are  chosen  at  random  from  a.vl  possible  flights. 

The  mathematical  model  is  still  written  as 

X  .  =  4  +  9  +  «  ..  (8.  5) 

U  •  1  ij 

but  the  interpretation  of  the  0^  is  different.  Here  0^^  is  a  random 
variable  having  a  probability  distribution  which  is  the  distribution  of 
flight  effects.  The  «  .  ,  i  =  i,  .  .  .  ,  c,  are  assumed  to  be  normally  distri¬ 
buted  with  zero  mean  and  common  variance  cr^  .  (A  test  for  this  assump¬ 
tion  is  given  in  Ref.  [  ^  ]  •  )  the  experiment  were  to  be  repeated,  a  new 
random  sample  would  be  drawn  and  different  flights  might  be  included. 
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In  the  fixed  effects  model,  repeating  the  experiment  would  mean  using 

the  same  four  flights.  Therefore,  for  the  random  effects  model,  all  the 

flights  are  equivalent  if  cr^  =  0.  This  model  is  called  the  "random 

effects"  model  because  ^  is  a  random  variable,  and  the  conclusions 

derived  from  the  experiment  will  be  extended  to  all  flights  from  which 

the  random  sample  was  drawn.  In  this  model  the  x,  .  are  normally 

Z  2  2^^  2 

distributed  with  mean  ^  and  variance  ct  +0"  =0"  since  cr  is 

(j>  0 

hypothesized  to  be  zero. 


8.  2.  2  Computational  Procedure 

Assume  that  the  following  data  has  been  taken  for  one  particular 
location  (see  Table  8.  1). 


Measurements 

_ _ _ _ _ 

1 

2 

3 

j 

— 

c 

1  Flights 

1 

^^12 

’^•13 

’^Ic 

2 

^21 

"^22 

’^25 

m 

i 

X 

i2 

B 

X.  . 

ij 

-  -  — 1 

X. 

1C 

T 

^rl 

X 

—  Ct 

X  . 

rj 

X 

re 

Table  8.  I  Arrangement  of  Vibration  Data 


An  analysis  of  variance  table,  such  as  that  shown  in  Table  8.  2,  will 
now  have  to  be  completed.  This  is  done  by  following  the  computational 
procedure  described  below. 

(1)  Calculate  totals  for  each  flight 


R 


r 


R 


r 


ASD  TDR  62-973 


8-5 


(2)  Calculate  over -all  total 

T  =  R-  +  R,  +  .  .  .  +  R 
12  r 


(3)  Compute  crude  total  sum  of  squares 

r  c 

y  y  2  2^2^  ^2 

/  /  x;.  =  x..+x,,+  ...+x 

2-*,  1 1  11  12  re 

1=1  j  =  l  J 

(4)  Calculate  crude  sum  of  squares  between  flights 

r 

c  c 


(5)  Calculate  correction  factor  due  to  mean 


Then, 

(6)  SS3  =  (4) 

(7)  SS  =(3) 

(8)  SS2  =  (7) 


(6)  =  SS  -  SS3 


3{C  >I<  ^ 

The  mean  square  values  SS  ,  SS^  >  and  SS3  can  now  be  calculated  by 

dividing  by  the  appropriate  degrees  of  freedom  as  shown  in  Table  8.  2. 

In  the  above  computational  procedure  SS,  and  SS,  correspond  to 

2  j  i  2 

the  between  group  variance,  N  s^^  ,  and  the  within  group  variance,  s  , 

of  Ref.  I  with  c  and  r  replacing  N  and  k  respectively.  The  major 

difference  is  that  SS,  and  SS,  are  the  unbiased  estimates  while 
2  2^ 

N  s_  and  s  are  biased.  That  is, 


and 


Nk  g2 
k(N  -  1) 
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The  F  test  is 


SS 


F  = 


SS- 


k  „  2 

ir^T 

Nk  2 


s-  (Nk  -  k) 


s  (k-  1) 


Nk-  k 

which  shows  that  the  tests  here  and  in  Ref.  |  i  j  are  equivalent.  Other 
equivalences  are  easily  seen.  For  instance,  the  so  called  "correction 
factor"  (using  the  terminology  of  Ref.  |  2  j  )  is  the  term  (Sx)^/Nk  in  the 
formula 

,2 


2 

s  = 


Sx. 


(Sx)- 

Nk 


Nk 


for  computing  a  sample  variance. 


(a)  Decision  Procedure,  Fixed  Effects  Model 

The  hypothesis  that  all  the  flights  are  equal  can  be  written  as 


H  :  04  =  = 


=  0, 


(8.6) 


In  fact,  if  the  hypothesis  is  true,  each  0^  must  equal  zero.  It  can  be 
shown  (Ref.  2  ,  p.  295)  that  the  hypothesis  (8.  6)  is  true,  if  the  ratio 
SS^  /SS2  (see  Table  8.  2)  is  distributed  as  an  F  random  variable  with 
(r  -  i)  and  r(c  -  1)  degrees  of  freedom.  Therefore,  the  hypothesis  (8.  6)  is 
accepted  if 


F  = 


SS. 


SS- 


~  ^a;  r  -  1,  r(c  -  I) 


(8.  7) 


where  a  is  the  level  of  significance  and  F 


Q;r-1,  r(c-l) 


is  the  upper  a 


percentage  point  of  the  F  distribution. 

If  the  hypothesis  (8.  6)  is  rejected,  it  is  possible  to  make  statements 
about  which  flights  differ.  Tukey  and  Scheffe  have  developed  a  method  which 
is  described  in  Reference|2j,  page  295,  where  the  average  vibration  level  of 
each  flight  can  be  compared.  'A  factor  k  is  calculated  as  follows. 


k  =  k 


SS. 


(8.8) 


where  k  is  obtained  from  the  table  in  Appendix  8.- A. 
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The  appropriate  degrees  of  freedom  are  those  corresponding  to  the  degrees 
of  freedom  of  the  within  flight  source  in  the  analysis  of  variance  table, 
i.  e.  ,  r(c  -  1).  Then  any  two  flight  averages  differing  by  more  than  k,  are 
said  to  differ  significantly.  The  average  vibration  level  of  the  ith  flight  is, 
of  course,  defined  as 

X. 

1* 


(b)  Decision  Procedure,  Random  Effects  Model 

Testing  the  hypothesis  about  the  homogeneity  of  flights  is  now 
equivalent  to  testing  the  hypothesis 

2 


H 


O’.  =  0 

0 


♦  ♦ 

Just  as  in  the  fixed  effects  model,  F  =  SS^  /  SS2 


(8.9) 

is  distributed  as  an  F 


random  variable  with  (r  -  1)  and  r(c  -  1)  degrees  of  freedom.  Therefore, 

2 

the  hypothesis  that  <r  =  0  is  accepted  if 


SS. 


ss. 


-  '  a;r-  I,  r(c-l) 


(8.  10) 


In  order  to  determine  a  measure  of  how  much  the  flights  differ,  the  quantity 
<r^  can  be  estimated.  An  estimate  of  is  given  by  (Ref.  t  p.  307) 

♦  ♦ 

o  SSn  ”  SS^ 

cr;=-i - L  (8.11) 

9  c 


If  this  quantity  is  negative,  the  estimate  is  taken  to  be  zero.  The  proba¬ 
bility  of  Type  II  error,  P,  i.  e.  ,  the  probability  of  accepting  the 

2  2 

hypothesis  =  0  or  <r^  =  0  when  in  fact  ^  0  or  <r^  4  0,  can  also  be 
estimated  from  a  set  of  Operating  Characteristic  Curves.  However, 
it  is  beyond  the  scope  of  this  report  to  do  so  and  the  reader  is  referred 
to  Ref.  ^  2  j . 
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8.  2.  3  Numerical  Example 

Assume  that  from  a  series  of  flights  made  by  a  particular  type  of 
aircraft,  four  flights  were  selected  at  random  and  during  these  four  flights, 
vibration  measurements  were  taken  at  several  points.  These  measure¬ 
ments  were  made  at  random  during  the  take-off,  cruise,  and  landing 
phases  of  the  flight  consisting  of  samples,  each  two  seconds  long.  For 
each  of  the  two- second  samples,  an  over- all  rms  acceleration  level  was 
determined,  resulting  in  the  following  data  for  one  particular  point: 


Flight  1:  7, 

8, 

9, 

8, 

8. 

c; 

1.  5,  2.  5, 

2, 

4, 

4.  5,  5,  4.  5,  4 

Flight  2:  8, 

7, 

9, 

7, 

8, 

6. 

2. 

5,  2,  1.  5, 

2, 

4, 

5,  4,  4.  5,  4.  5 

Flight  3:  8, 

9, 

7. 

9, 

7, 

5. 

2. 

5,  2.  5,  1. 

5, 

2, 

3.  5,  4,  4.  5,  4,  5 

Flight  4:  7, 

9, 

8, 

7, 

9, 

5, 

1. 

5,  2,  2,  2. 

5, 

4, 

4,  3.  5,  5,  3.  5 

Arranging  this  data  in  tabular  form  as  that  shown  in  Table  8.  1, 
results  shown  in  Table  8.  3  are  obtained. 


Vibra::io:' 

1  Le\ 

•e.ls 

tic 

•ei 

1 

2 

3 

B 

5 

B 

B 

8 

Q 

10 

11 

12 

13 

14 

15 

Totals 

1 

7 

8 

9 

8 

8 

B 

2. 

1.5 

2.5 

2. 

4. 

4.5 

5. 

4.5 

4. 

75.  0 

B 

8 

7 

9 

7 

8 

B 

2.5 

2. 

1.5 

2. 

4. 

5. 

4. 

4.5 

4.5 

75.  0 

B 

8 

9 

9 

B 

5 

2.5 

2.5 

1.5 

2. 

3.5 

4. 

4.5 

4. 

5. 

74.  5 

B 

9 

B 

B 

5 

1.5 

2, 

'> 

2.5 

4 

4. 

3.5 

5. 

3.5 

73.  0 

Grand  Total 

297.  5 

Table  8.  3  Pairing  of  Flights  and  Vibration  Levels 


Following  the  computational  procedure  of  Section  2.  2  yields 
(1)  =  75.  0,  75.0,  74.5,  73.0 


(2) 

(3) 


T  =  297.  5 


1,822.  25 
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4  „2 

22,129.25 

—  =  -  =  1,475.28 

i=l  c  15 


88,  506.  26 


=  1,475.  10 


SS,  =  )  -L  -  =  0.  18 

3  fr*4  c  re 


re  y 

=  y  y  x.^  -  I-  =  347.  15 
re 


SS2  =  SS  -  SS3  =  346.  97 


The  completed  analysis  of  variance  table  is  shown  in  Table  8.  4. 


Source 

Sum  of  Squares 

Between 

Flights 

SS3  =  0.  18 

Within 

Flights 

SS2  =  346. 97 

Total 

SS  =  347.  15 

Degrees  of 

Freedom  Mean  Square 


♦  SS 

r  -  1  =3  SS.,  =  - -  =  0.  06 

^  3 


SS 

r(c-l)  =  56  SSy  =  - -  =6.  20 

^  56 


rc  -  1  =59  SS*  =  —  =  5.  88 

59 


Table  8.4  Analysis  of  Variance  Table,  One-Way  Classification 
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(a)  Random  Effects  Model 

Since  the  four  flights  were  selected  at  random,  and  conclusions 
are  to  be  drawn  about  all  other  simiiar  flights,  the  random  effects  model 
should  be  used. 

In  Section  8.  2.  2(b),  it  was  shown  that  testing  the  hypothesis  about  row 

2 

effects  (between  flights)  is  equivalent  to  testing  ®  accepted 

if 


F  = 


F 


q;3,  56 


from  Eq.  (8  10).  Choosing  a  level  of  significance  a  =  0.  05  and  looking 

up  Fq  5^  F  tables  (Ref.  [  2j  ,  p.  560)  one  obtains 


SS 


F  = 


SS, 


0-  06  ^ 

-  «  F  o  =  2.  76 

6.  20 


and,  therefore,  accept  H 


<1^  =  0 
9 


An  estimate  of  cr^  was  given  by  Eq.  (8.  11)  and  is 


A  2 
'^0  ^ 


0  06  -  6.  20 
15 


which  is  taken  to  be.  zero  since  <r 


9 


0. 


This  procedure  should  now  be  repeated  for  the  other  locations  and 

2 

if  for  all  these  locations  the  hypothesis  H  :  cr  =  0  is  accepted,  the 

r 

procedure  discussed  in  Section  8.  4  should  now  be  applied  to  make  the 
decision  about  the  within  flight  variations  and  the  between  locations 
variations. 


(b)  Fixed  Effects  Model 

Z 

If  the  hypothesis  Hitr.  =  0  had  been  rejected,  the  fixed  effects 

9 

model  could  have  been  employed  to  find  out  which  of  the  four  flights  differed 
significantly.  The  result  of  the  hypothesis  H :  =  0  is  the  same  for  this 

example,  but  the  change  in  concept  now  allows  one  only  to  draw  conclusions 
about  the  four  flights  that  were  made.  But  now,  that  is  all  that  is  necessary. 
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One  could  now  compute  k  from  Eq.  (8.  8)  and  any  two  flight  averages 
(e.  g.  s  the  average  vibration  level  of  Flight  1  is  75.  0/15  =  5  g's  rms) 
differing  by  more  than  k  are  said  to  differ  significantly. 

Although  this  procedure  of  switching  models  may  be  somewhat 
useful  in  practice,  one  is  on  dangerous  theoretical  ground.  Note  that  the 
switch  to  the  fixed  effects  model  concept  is  made  if  and  only  =  0 

is  rejected.  But  consider  the  situation  if  an  error  of  the  first  kind  has 
been  made.  This  would  mean  that  sampling  error  is  being  accepted  as 
fact,  and  further  tests  are  applied.  It  is  clear  that  the  same  level  of 
significance  and  power  ( 1  -  P)  for  these  subsequent  tests  cannot  be  what 
they  seem  on  the  surface.  The  sample  being  worked  with  has  been 
"conditioned"  by  the  first  test,  but  the  probabilities  on  which  this  second 
test  is  based  do  not  take  this  into  account. 


8.  3  TWO-WAY  ANALYSIS  OF  VARIANCE,  ONE  OBSERVATION 
PER  COMBINATION 

As  discussed  previously,  this  procedure  applies  when  measurements 
during  several  flights  were  made  at  one  single  point  within  the  flight  vehicle. 

8.  3.  1  Mathematical  Models 

(a)  Fixed  Effects  Model 

Again,  let  x^j  be  the  jth  vibration  measurement  of  the  ith 
flight.  This  measurement  can  be  in  terms  of  mean  square  acceleration, 
rms  acceleration,  peak  amplitude,  or  any  other  type  that  may  be  required. 
The  mathematical  model  can  then  be  written  as 


X. .  =  4. .  +  *  . . 

ij  ij  iJ 


(8.  12) 


where  is  jlh  mean  vibration  level  during  the  ith  flight  (the 

expected  value  of  x^j)  and  « ^ ^  is  a  random  effect  which  is  assumed  to  be 

independently  normally  distributed  with  mean  0  and  unknown  variance 
2 

(T  .  (See  Tables  8.  5  and  8.  6.  ) 

From  Table  8.  6  one  can  write  for  the  mean 

^..  =  4  +*.  +  y.  +7?..  (8.13) 

ij  .  •  J  '  ij 

where  7?.-  =  ^■-  ■  C-,  -  ^  •  +  ^  and  is  known  as  the  interaction  term, 
lij  ij  1’  '  J 
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Vibration  Levels 


Totals 


Table  8.  5  Pairing  of  Flights  and  Vibration  Levels 


Vibration  Levels 

Avei  age 

Differences 

1 

y 

" 

j 

c 

Over- 

Levels 

1 

— 

■o- 

II 

IT* 

1 

• 

Flights 

i 

^21 

^22 

BB 

^2c 

^2- 

♦2=^2. 

H 

1 

II 

fl 

^r2 

'rj  1 

‘rc 

6=4  -  . 

Tr  ’ 

Average 

over 

Flights 

^.1 

^.2 

'■i 

_ 1 

‘  c 

Over -all 
Average 

. 

Differ¬ 

ences 

m 

Y2  =  2  ■  . 

■H 

MBBl 

Table  8.  6  Table  of  Expected  Values  of  Vibration  Levels 
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An  interaction  between  two  effects  and  Yj  said  to  exist  if  the  joint 
effect  of  the  two  taken  together  is  different  from  the  sum  of  the  separate 
effects.  For  example,  assume  there  are  five  machines  and  four  opera¬ 
tors,  and  it  is  desired  to  test  whether  the  machines  differ  in  the  number 
of  units  produced  per  day.  It  is  possible  that  the  second  operator  works 
much  better  on  the  third  machine  than  on  the  others.  The  resultant  in¬ 
crease  in  production  of  the  third  machine,  therefore,  cannot  be  assumed 
to  be  a  characteristic  of  the  man  only  or  the  machine  only,  but  is  due  to 
the  "interaction"  of  that  particular  man  with  that  particular  machine. 

From  Eq.  (8.  13)  one  sees  that  the  mean  for  the  ith  flight  and  jth 
measurement  is  written  as  a  constant  4  plus  an  effect  due  to  the  ith 
flight  which  is  constant  over  all  vibration  levels,  plus  an  effect  due  to 
the  jth  vibration  level  which  is  constant  over  all  flights,  plus  an  inter¬ 
action  term  7^ . .  .  Testing  whether  the  flights  are  homogeneous  is 
equivalent  to  testing 

H  :  =  ^2  =  •  •  •  =  °  {8-14) 

Testing  whether  the  vibration  levels  from  time  period  to  time  period  are 
homogeneous  is  equivalent  to  testing 

H  :  Yi  =  Y2  =  •  •  •  =  Yc  "  ®  (8.  15) 

and  testing  for  no  interaction  is  equivalent  to  testing 

H-.T;..  =0  (8.16) 


for  all  i  and  j. 

It  should  again  be  emphasized  that  the  inference  drawn  from  the 
above  tests  only  apply  to  the  particular  flights  made  and  the  vibration 
levels  measured.  Inferences  about  other  similar  future  flights  or 
vibration  levels  not  measured  cannot  be  made  using  the  above  model. 

One  other  comment  must  be  made  concerning  the  interpretation  of 
the  analysis  as  a  test  for  stationarity.  Every  flight  must  be,  in  concept, 
broken  down  in  advance  into  a  finite  set  of  time  periods.  For  example, 
if  two-second  records  are  being  collected  from  a  two-hour  flight,  think 
of  the  flight  as  3600  time  periods.  Then  certain  of  these  time  periods  are 
selected  (the  same  for  all  flights)  and  samples  are  drawn  from  these  specific 
time  periods  for  each  flight.  In  the  fixed  effects  model,  no  very  satisfactory 
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interpretation  of  the  test  for  equivalences  of  data  from  these  different 
time  periods  is  available.  However,  in  the  random  effects 

models  to  be  described,  a  subset  of  these  time  periods 
would  be  randomly  selected.  (These  time  periods  would  correspond  to 
the  random  sampling  plan  which  would  of  necessity  be  the  same  for 
every  flight  to  allow  this  model  to  make  sense.  )  Now,  the  test  for  equiva¬ 
lence  of  measurements  from  the  various  time  periods  can  be  interpreted 
in  some  cases  as  a  test  for  stationarity.  This  is  described  in  Section  16. 

It  should  also  be  noted  that  since  only  one  measurement  is  avail¬ 
able  for  the  ith  row  and  jth  column  (as  shown  in  Table  8.  5),  one  cannot 
test  for  interaction  and  it  has  to  be  assumed  that  interaction  does  not 
exist. 


(b)  Random  Effects  Model 

As  indicated  above,  more  useful  results  would  be  obtained  if 
inferences  could  be  drawn  about  all  other  similar  flights  and  all  possible 
measurements.  Here  it  will  be  assumed  that  the  four  flights  of  the 
previous  section  were  selected  at  random  from  many  possible  flights  and 
that  the  measurements  were  made  at  random  throughout  each  of  the  flights. 
The  mathematical  model  can  still  be  written  as  (combining  £qs.  (8.  12)  and 
(8.  13)) 


X.  . 

ij 


+  € 


IJ 


(8.  17) 


but  the  interpretation  is  different.  The  (between  flight  effects),  the 
y.  (within  flight  effects)  and/?.,  (interaction  effects)  are  now  independent 

J  2  2  2 

random  variables  all  having  mean  0  and  variance  cr^  ,  cr^  ,  and 
respectively.  The  random  variable  €  is  assumed  to  be  normally 
distributed.  The  random  variables,  0,  y,  and are  also  often  assumed 
to  be  normally  distributed  if  further  inferences  aboii;  these  components 
are  to  be  made. 


Here  the  inferences  about  row  effects  (between  flights),  column 

effects  (within  flights),  and  interaction  is  equivalent  to  making  inferences 

2  2  2  2 
about  (T^  ,  (T^  ,  and  0)^  respectively.  For  example,  if  =  0,  all  the 

flights  are  homogeneous. 
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(c)  Mixed  Effects  Model 

The  previous  two  sections  dealt,  with  the  two-way  analysis  of 
variance  when  both  the  Flights  and  Measurements  were  considered  as 
fixed  effects,  or  when  both  were  considered  as  random  effects.  A  third 
possibility  is  to  consider  the  Flights  as  fixed  effects  and  the  Measure¬ 
ments  as  random  effects,  or,  to  consider  the  Flights  as  random  effects 
and  the  Measurements  as  fixed  effects.  This  model  is  denoted  the 
"mixed  effects  model.  "  It  should  be  emphasized  that  the  decision  as  to 
whether  the  flights  or  measurements  are  fixed  or  random  effects  is  a 
practical  one  and  is  not  up  to  the  statistician.  If  the  vibration  engineer 
wishes  to  draw  conclusions  only  about  the  measurements  that  were  made, 
and  does  not  want  to  generalize  the  results,  the  measurements  are  then 
considered  fixed  effects.  This  would  be  equivalent  to  making  inferences 
about  Y-  •  engineer  then  wants  to  extend  his  conclusions  to  other 

flights  not  included  in  his  experiment,  the  flights  are  then  considered  as 
random  effects,  but  he  has  to  make  sure  that  the  flights  chosen  were 

selected  at  random  from  .all  the  possible  flights.  This  would  be  equiva- 

2 

lent  to  making  inferences  about  c  .  The  usefulness  of  this  model  will 

<P 

become  clear  in  Section  8.  3.  3. 


8.  3.  2  Computational  Procedure 

In  order  to  keep  track  of  all  the  calculations  that  have  to  be  made, 
it  is  recommended  that  an  "Analysis  of  Variance  Table"  be  constructed 
similar  to  that  shown  in  Table  8.  7.  To  complete  this  table,  the  follow¬ 
ing  computational  procedure  can  be  employed.  The  subscripts  r  and  c 
will  be  used  to  denote  the  number  of  rows  and  columns,  respectively. 

The  relationships  between  the  computational  procedure  and  the  individual 

measurements  x,. .  of  Table  8.  5  are  shown  in  Table  8.  7. 
ij 

(1)  Calculate  row  totals 

Rr  ^2’  •  •  •  '  Rf 


(2)  Calculate  column  totals 

Cj,  C^, 


C 

c 
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Degrees  Mean  Expected  Mean  Square  Expected  Expected  Mean 

Source  Sum  of  Squares  of  Square  for  the  Fixed  Effects  Mean  Square  Square  for  the 

Freedom  Model  for  the  Ran-  Mixed  Effects 

dom  Effects  Model 

Model 
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Table  8.  7.  Analysis  of  Variance  Table,  Two-Way  Classification, 
One  Observation  per  Combination 


(3)  Calculate  over -all  total 


T  =  +  R2  +  .  .  .  +  R^  =  Cj  +  C2  +  .  .  .  + 

(This  also  provides  a  check  for  row  and  column  totals.  ) 

(4)  Calculate  crude  total  sum  of  squares 
r  c 


I  I  =X 

1=1  J=1 


2  2 
11  ’^12''‘  • 


+  X 


rc 


(5)  Calculate  crude  sum  of  squares  between  rows 


2  2  2 
Rl  +R2  +  ••• 


1=1 


(6)  Calculate  crude  sum  of  squares  between  columns 


^  2  I 

j=l  r 


2  2 

Cl  +  C2  + 


■  *  <  1 


(7)  Calculate  Correction  Factor  due  to  mean 


rc 


(8) 


(9) 

(10) 


c  C 

ss.  =  (6)  -  (7)  =  y  J_ 

k  ^ 

SS3  =  (5)  -  (7)  =  ^ 

Ul 


rc 


rc 


SS 


=  (4)  -  (7)  = 


I  I 

i^I  j=l 


2 
X.  . 

ij 


rc 


(11)  SS2  =  (10)  -  (9)  -  (8)  =  SS  -  SS3  -  SS^ 

Now  the  Analysis  of  Variance  Table  can  be  completed  by  calculating  the 

^  )Qc 

values  of  SS^  ,  SS3  >  and  SS2  3.8  shown  in  Table  8.  7. 
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(a)  Decision  Procedure,  Fixed  Effects  Model 


Before  applying  the  decision  procedure  for  the  fixed  effects 
model  with  only  one  observation  per  cell,  it  should  be  noted  that  the  inter¬ 
action  term  must  be  zero.  As  mentioned  in  Section  8.  3.  1,  a  test  for 
interaction  cannot  be  made;  therefore,  the  designer  of  the  experiment 
should  make  sure  that  the  interaction  can  be  assumed  to  be  zero. 

It  was  shown  in  Section  8.  3.  1  that  testing  the  hypothesis  about  the 
homogeneity  of  flights  is  equivalent  to  testing  the  hypothesis 


H:  0^  =  02  =  •  •  •  =  0,, 


It  can  be  shown  (Ref.  [2],  p.  323)  that  this  hypothesis  is  true  if  the  ratio 
SS^  /SS2  is  distributed  as  an  F  random  variable  with(  r  -  1)  and 
(r  -  l)(c  -  1)  degrees  of  freedom.  Therefore,  the  hypothesis  of  the  equality 
of  the  0's  is  accepted  if 


F  = 


-  ^a;(r-l),(r-l)(c-l) 


(8.  18) 


Similarly,  the  hypothesis  of  equality  of  the  y’ a  (no  flight  effects)  is 
accepted  if 


F  = 


^a;(c-I),(r-I)(c-l) 


(8.  19) 


If  the  hypothesis  that  there  are  no  between  flight  effects  or  no 
within  flight  effects  or  both  is  rejected,  the  Tukey  k  factor  can  again  be 
used  to  determine  which  row  or  which  column  averages  differ  signifi¬ 
cantly.  The  equations  are 


k  (for  rows) 


=  k 


k(for  columns)  =  k 


(8.  20) 


(8.21) 


Again,  k  is  read  from  the  tables  in  Appendix  8TA.The  proper  degrees  of 
freedom  are  those  corresponding  to  the  degrees  of  freedom  of  the  residual 
source  in  the  analysis  of  variance  table,  i.  e.  ,  (r-l)(c-l). 
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(b)  Decision  Procedure,  Random  Effects  Model 


For  this  procedure,  no  assumption  has  to  be  made  about  the 

interaction  being  zero.  In  the  random  effects  model,  it  was  shown  that 

testing  the  hypothesis  about  the  row  effects  (between  flights)  is  equiva- 

2 

lent  to  testing  the  hypothesis  H:<r  =  0.  It  can  be  shown  (Ref.  [Z],  p.  327) 

that  the  ratio  SS^  /SS2  is  distributed  as  an  F  random  variable  with 

(r  -  l)and  (r  -  l)(c  -  1)  degrees  of  freedom  when  the  hypothesis  is  true. 

2 

Therefore,  the  hypothesis  that  <r  =  0  is  accepted  if 


SS, 


F  = 


ss 


«  -  ^a;(r-l),(r-l)(c-l) 


(8.  22) 


Similarly,  the  hypothesis  of  no  column  effects  (within  flight  effects), 

2 

i.  e.  ,  the  hypothesis  that  or  =  0  is  accepted  if 


SS. 

p  ^  p 

=  *a;(c-l),(r-l)(c-l) 

SS2 


(8.23) 


In  order  to  obtain  a  measure  of  how  much  the  row  effects  or  column 

2  2 

effects  differ,  the  quantities  or  and  o*  can  be  estimated.  These 

9  Y 

estimates  are  given  by 


*  * 
^  2  ^^3  ■  ®^2 

‘'9  " 


(8.  24) 


^2  SS^  -  SS2 

(T  =  - 

Y 


(.8'.  25) 


If  any  of  these  quantities  is  negative,  the  estimate  is  ted^en  to  be  zero. 


(c)  Decision  Procedure,  Mixed  Effects  Model 

In  the  mixed  effects  model,  the  row  effects  will  be  assumed  as 

the  random  effects  and  the  column  effects  will  be  assumed  as  the  fixed 

effects.  Therefore,  testing  the  hypothesis  about  the  homogeneity  of  row 

effects  (between  flight  effects)  is  equivalent  to  testing  the  hypothesis 
2 

H :  O’  =  0.  Equation  (8.  22)  can  now  be  used  to  test  the  hypothesis  and 
9  2 

Eq.  (8.  24)  can  be  used  to  estimate  a 
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Testing  for  homogeneity  of  column  effects  (within  flight  effects)  is 
equivalent  to  testing  the  hypothesis  =  Y2  ~  •  '  •  “  ~  Equation 

(8.  19)  can  therefore  be  used  to  test  for  the  hypothesis  of  equality  of  the 
Y's  and  if  the  hypothesis  is  rejected,  Eq.  (8.  21)  can  be  used  to  determine 
which  columns  differ  significantly. 

There  is  one  important  difference  here  from  the  fixed  effects 
model.  Even  though  the  column  effects  are  fixed,  no  assumption  has  to 
be  made  about  the  interaction,  i.  e.  ,  the  presence  of  interaction  does 
not  invalidate  the  decision  procedure  for  the  mixed  effects  model. 


8.  3.  3  Numerical  Example 

For  simplicity,  the  same  data  will  be  used  here  as  that  used  for 
the  example  in  Section  8.  2.  2.  This  data  is  reproduced  in  Table  8.  8, 
showing  the  row  totals,  column  totals,  and  the  column  averages. 

4  15  2 

^  ^  x...  =  1,822.25 

i=l  j  =  l 


4  2 

y  22,  129.  25 

itl—  =  - - -  =  1,475.28 


15  C 


_  7,  217.  25 


=  1.  804.  31 


rc  80 


15  cf'  2 

SS.  =  E  =  329.  21 

’  j=l  r  rc 


SS, 


o.u 


i=l  c  rc 


4  15  , 

SS  =  f  E  Xj:  -  —  =  347.  15 
i=l  j  =  l  rc 


SS2  =  SS  -  SS3  -  SS4  =  17.  76 

The  completed  Analysis  of  Variance  Table  is  shown  in  Table  8.  9. 
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Source 

Sum  of  Squares 

Degrees  of 
Freedom 

Mean  Square 

Within 

Flights 

SS4  =  329. 21 

(c-1)  =  14 

*  SS. 

SS*  = - -  =  23.  52 

^  14 

Between 

Flights 

SS.^  =  0.  18 

Xc  SS- 

SS,  =  — -  =  0.  06 

^  3 

Residual 

SS^  =  17.  76 

(r-l)(c-l)=42 

*  SS2 

SS,  =  — -  =  0.  42 

2  42 

Total 

SS  =•■  347.  15 

.:rc-l)  =  59 

SS*  =-^  =  5.  88 

59 

Table.  8.  9  An.alysis  of  Variance  Table 


(a)  Random  Effects  Model 


Since  both  th«.  flights  and  the  measurements  were  made  at  ran¬ 
dom,  and  inferences  a.'e  to  be  drawn  about  all  the  flights  and  the  entire 
vibration  environment  of  a.J  these  flights,  the  random  effects  model  will 

be  used.  Choosing  a  level  of  significance  a  =  0.  05,  the  between  flight 

2 

homogeneity  is  tested  by  Eq.  {8.  22),  namely  the  hypothesis  H  :  (t  =  0  is 

0 

accepted  if 


SS 


F  = 


SS- 


0.  06 
0.  42 


-  ^0.  05;  3,  42 


From  the  F  tables  (Ref.  [2]  ,  p.  560)  one  obtains  Fq  ^  42  ~ 
therefore  accept  the  hypothesis,  i.  e.  ,  there  are  no  significant  difference! 
between  flights,  since  F  =  0.  14. 

The  homogeneity  of  the  v/ithin  flight  vibration  levels  is  tested  by 

2 

Eq.  (8.  23)  Namely,  the  hypothesis  Hro-  =  0  is  accepted  if 


SS 


F  = 


SS. 


23.  52 
0.  42 


-  '0.05;  14,42 
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From  the  F  tables  one  obtains  Fq  -  1.  93  and  therefore  rejects 

the  hypothesis,  i.  e.  ,  there  is  a  significant  difference  of  vibration  levels 
within  flights,  since  F  =  56.  0. 

Another  interpretation  of  this  result  was  mentioned  in  Section  8.  3.  1. 
That  is,  the  vibration  flight  history  of  these  flights  from  which  these 
samples  were  taken  is  a  nonstationary  process.  Therefore,  the  above 
analysis  of  variance  technique  provides  one  with  a  test  for  stationarity. 

A  measure  of  how  much  the  within  flight  data  varies  is  given  by 
Eq.  {8.  25) 

J  ‘  =  _5 _ I  =  5,  78 

Y  r  4 


Therefore  an  estimate  of  the  standard  deviation  of  the  within  flight  data 


~  S's  rms 


It  should  he  noted  that  by  looking  at  the  original  data  the  within 
flight  variations  appear  to  follow  the  flight  phases.  Very  high  vibration 
levels  were  recordea  during  the  “.ake -off  phase,  low  xevels  were  recorded 
during  the  cruise  phase,  and  intermediate  levels  were  recorded  during  the 
landing  phase.  The  above  procedure  tested  whether  the  differences  of 
vibra,tion  levels  betv/een  phase, s  were  significant.  Since  they  were  signifi¬ 
cant,  no  conciusioris  can  nov/  be  drav/n  about  the  within  flight  vibration 
;..evels  as  a  v/hole. 

Hov/ever  it  appears  that  if  a  separate  analysis  of  variance  is  per¬ 
formed  for  each  flight  phase,  the  hypothesis  of  homogeneity  might  be 
accepted.  The  problem  nov/  arises  to  de*^ermine  where  one  flight  phase 
leaves  off  and  the  next  one  begins.  A  quantitative  method  is  available  to 
do  this.  Since  the  division  is  to  be  made  only  for  the  vibration  levels 
that  were  recorded,  a  mixed  effects  model  can  be  assumed. 
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(b)  Mixed  Effects  Model 


The  hypothesis  now  has  become  H  ;  =  Y2  ~  ‘  ‘  ‘  ~ 

previously  discussed,  the  F  statistic  is  the  same.  However,  the  change 
in  concept  allovys  us  now  to  determine  (with  the  cautions  previously 
mentioned)  which  particular  vibration  levels  of  the  15  differ  significantly. 

The  Tukey  k  factor  given  by  Eq.  (8.  21)  can  now  be  used.  For  this 
example  k  =  5.  1 1  (from  the  tables  in  Appendix  8 -A),  and 


k  = 


5.  11 


V¥ 


=  1.  66 


From  Table  8.  8  one  can  see  that  measurements  1  through  5  can  be  con¬ 
sidered  as  one  phase,  measurements  7  through  10  as  one  phase,  and 
measurements  11  through  15  as  one  phase.  Measurement  number  6 
should  be  lumped  with  numbers  1  through  5  since  it  is  closer  to  the  take¬ 
off  phase  than  the  cruise  phase.  The  analysis  of  variance  can  now  be 
repeated  for  the  four  flights,  using  only  one  flight  phase  at  a  time.  To 
draw  conclusions  about  each  particular  phase  for  all  flights,  the  random 
effects  model  should  be  used. 

A  note  of  caution  is  due  at  this  point.  From  the  data  in  Table  8.  8 
it  would  appear  that  the  flight  phases  could  have  been  separated  just  by 
inspection.  However,  many  times,  data  that  appears  to  differ  actually 
does  not  differ  significantly  in  the  statistical  sense,  or  data  that  appears 
to  be  uniform  may  be  rejected  as  homogeneous  by  the  proper  statistical 
techniques. 
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TWO-WAY  ANALYSIS  OF  VARIANCE,  SEVERAL 
OBSERVATIONS  PER  COMBINATION 


8.  4 


In  the  previous  section,  vibration  measurements  were  made  only 
at  one  point  within  the  flight  vehicle  for  each  of  the  flights.  However,  it 
may  be  desired  to  make  measurements  for  each  flight  at  several  points 
simultaneously.  For  example,  electronic  equipment  is  to  be  installed 
in  the  pilot's  compartment,  in  the  mid- section,  and  near  the  tail  of  the 
aircraft.  Vibration  measurements  would  then  be  made  at  each  of  these 
locations.  The  question  now  arises,  can  one  establish  an  over-all 
vibration  specification  for  all  three  locations  or  will  a  separate  specifi¬ 
cation  be  required  for  each  of  the  three  locations.  This  will  require  a 
decision  whether  or  not  the  vibration  levels  at  the  three  locations  can  be 
considered  as  statistically  equivalent. 

First,  a  one-way  analysis  of  variance  has  to  be  made  for  each  of 
the  three  locations  separately,  as  discussed  in  Section  8.  2,  to  test  for 
between  flight  differences.  If  the  between  flight  measurements  for  each 
cf  the  locations  turns  out  to  be  not  statistically  equivalent,  obviously  no 
further  analysis  is  required  since  conclusions  about  other  flights  cannot 
be  drawn.  If,  however,  flights  can  be  considered  as  equivalent,  one  can 
now  determine  if  the  locations  and  the  within  flight  differences  are 
statistically  equivalent. 

8.  4.  1  Mathematical  Models 

A  table  should  be  constructed  as  that  shown  in  Table  8.  10.  In 

Table  8.  10,  x. .  is  the  ith  measurement,  at  the  jth  location  for  the  vth 
ijv 

flight.  It  should  be  noted  in  Table  8.  10  that  the  symbols  r,  c,  and  n 
always  refer  to  the  total  number  of  rows,  columns,  and  observations 
per  combination,  regardless  of  what  they  represent. 

The  reader  should  also  note  that  if,  as  discussed  above,  the  three 
locations  were  deliberately  chosen,  they  will  always  have  to  be  considered 
as  fixed  effects,  and  all  inferences  drawn  apply  only  to  those  three  loca¬ 
tions.  If  the  flights  and  the  measurements  were  chosen  at  random,  it 
should  be  clear  that  a  mixed  effects  model  should  be  used.  For 

convenience  in  the  mixed  effects  model,  the  columns  are  usually  designated 
as  the  fixed  effects.  Of  course,  if  the  locations  were  chosen  at  random. 
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Locations 


♦ 


Table  8.  10  Arrangement  of  Data  for  Two-Way  Analysis  of 
Variance,  n  Observations  per  Combination 


the  random  effects  model  would  apply  and  conclusions  could  then  be 
drawn  about  locations  where  measurements  were  not  made.  It  should 
also  be  noted  that  since  more  than  one  observation  is  available  per  com¬ 
bination,  the  experimenter  can  now  test  for  interaction. 

The  general  mathematical  model  now  is  as  follows: 


i  =  1,  2,  .  .  .  ,  r 
j  =  1,  2, .  .  .  ,  c 
V  =  1,  2, .  .  .  , n 


(8.  26) 


where  .  is  the  general  mean  and  *jjy.  experimental  errors 

which  are  assumed  to  be  independently  normally  distributed  each  with 

2 

mean  0  and  variance  a  . 
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(a)  Fixed  Effects  Model 


In  the  fixed  effects  model,  is  the  effect  of  adding  the  ith 
r 

fixed  measurements  ^  <j)^  =  0,  is  the  effect  of  adding  the  jth  fixed 
c 

location  ^  =  0,  and 7?^.  is  the  fixed  interaction  of  the  ith  measure 

j=l  ^ 

ment  with  the  jth  location. 


(b)  Random  Effects  Model 


In  the  random  effects  model,  <p^  is  the  effect  of  adding  the  ith 
measurements  and  is  a  random  variable  and  is  usually  assumed  to  be 


normally  distributed  with  mean  0  and  variance  cr 


0 


v.  is  the  effect  of 


adding  the  jth  location  and  is  a  random  variable  usually  assumed  to  be 

2 

normally  distributed  with  mean  0  and  variance  o-^  , 

is  the  interaction  of  the  ith  measurements  with  the  jth  location 

and  is  also  a  random  variable  usually  assumed  to  be  normally  distributed 

2 

with  mean  0  and  variance 

(c)  Mixed  Effects  Model 

Here  is  the  effect  of  adding  the  ith  measurement  and  is  a 

random  variable  assumed  to  be  normally  distributed  with  mean  0  and 
2 

variance  cr  , 

^  c 

y.  is  the  effect  of  adding  the  jth  fixed  location,  ^  y  =  ^  • 

'  j  =  l  ' 

7^..  is  the  interaction  of  the  ith  random  measurement  with  the  jth 

fixed  location  and  is  a  random  variable  usually  assumed  to  be  normally 

2 

distributed  vrith  mean  0  and  variance  . 


8.4.  2  Computational  Procedure 

An  analysis  of  variance  table  as  shown  in  Table  8.  11  will  now  have 
to  be  completed.  The  following  computational  procedures  can  be  used 
for  this  purpose: 

(1)  Calculate  row  totals:  Rj,  R^.  .  .  ■  ,  R^ 

(2)  Calculate  column  totals:  C^*  C21  •  •  •  • 
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Degrees'  Mean  Expected  Mean  Square  Expected  Expected  Mean 

Source  Sum  of  Squares  of  Square  for  the  Fixed  Effects  Mean  Square  Square  for  the 

Free-  Model  for  the  Ran-  Mixed  Effects 

dom  dom  Effects  Model 
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Table  8.  11.  Analysis  of  Variance  Table,  Two-Way  Classification, 
n  Observations  per  Combination 


(3) 

(4) 

(5) 


(6) 


(7) 


(8) 


(9) 


From  the 

(10) 


(H) 


(12) 


Calculate  within  combination  totals;  W44.  Vf .  ,  Vf 

11  rc 

Calculate  over -all  total: 


T  =  R.  +  R,  +  .  .  .  +  R  =  C.  +  C,  +  .  .  .  +  C^ 
12  r  1  2  c 

Calculate  crude  sum  of  squares: 

2_2  2,  .2 

Z,  Z,  Z  *ijv  ■  ’^111  *112  *rcn 

1=1  j=l  v=l 


Calculate  crude  sum  of  squares  between  columns 

c  cj_  ^  |cf 
i=l  rn  rn 

Calculate  crude  sum  of  squares  between  rows 


E  —  = 

i=i 


cn 


Calculate  crude  sum  of  squares  between  combinations 
2  I  2  2  -2  \ 

r  c  W..  W,  ,  +  W,  ,  +  .  .  .  +  W 
f"  r  ij  _  I  11  12  rc/ 

iTl  jtl  n  ■  n 


Calculate  correction  factor  due  to  mean 

™,2 


C.  F.  = 


rcn 


quantities  above  compute: 

C  C.  T  ^ 

SS.  =  (6)  .  (9)  =  5;  - L. 

j  =  l  rn  rcn 


r  R  ^  2 

SS5  =  (7) .  (9)  =  y  -i - 1- 

•5  cn  rcn 


c  W,^ 


SS,  =  (5)  -  (8)  =  Z  Z.  1.  xyt  -1.  X. 


i=l  j=l  v=l 


i=l  j=l 
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(13)  SS 


n 


=  <5)-(9)=  £  £  £ 

1=1  j=l  v^l 


x: 


ijv 


rcn 


(14)  SS^  =  SS  -  SSj  -  SS3  -  SS4 

>!c  5l<  >lc  i'f  >1' 

The  mean  square  values  SS  >  SSj  ,  SS^  >  SS3  ,  and  SS^  can  now 
be  calculated  by  dividing  by  the  appropriate  number  of  degrees  of 
freedom  as  shown  in  Table  8.  11. 


(a)  Decision  Procedure,  Fixed  Effects  Model 

The  first  hypothesis  that  should  be  tested,  when  the  fixed 
effects  model  is  used,  is  for  no  interaction.  This  is  equivalent  to  test¬ 
ing  H-.yj..  -  0  for  all  1  and  j.  It  can  be  shown  (Ref.  [zj.p.  336)  that  if 
the  hypothesis  of  no  interaction  is  true,  SS^/SSj  is  distributed  as  an 
F  random  variable  with  (r-i)(c-l)  and  rc(n-  1)  degrees  of  freedom. 
Therefore,  the  hypothesis  7^, ^  =  0  is  accepted  if 


SS. 


F  = 


2  F 


SS, 


a;(r-  l)(c-  1),  rc(n-  1) 


(8.27) 


If  this  hypothesis  is  rejected,  the  tests  for  significance  of  the  within 
flight  effects  (row  effects),  and  between  locations  effects  (column 
effects),  are  now  meaningless.  If  the  hypothesis  that  there  is  no  inter¬ 
action  is  accepted,  tests  for  row  effects  and  column  effects  can  be  made. 

It  can  be  shown  (Ref.  [  2]  ,  p.  338)  that  if  the  hypothesis  about  no 
row  effects  is  true,  SS3  /SS^  is  distributed  as  an  F  random  variable 
with  (r-l)  and  rc(n-l)  degrees  of  freedom.  Therefore,  the  hypothesis 
H:0j=09  =  -’  -  =0j.  =  O  is  accepted  if 


F  = 


SS4 


^a;(r-l),  rc(n-l) 


(8.  28) 


Similarly  the  hypothesis  of  no  column  effects,  i.  e.  ,  H  :  Yj  “  Y2  ~ 
is  accepted  if 


F  = 


^a;(c-l),  rc(n-l) 


=  Y  =  0 

•c 

(8.  29) 
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If  the  row  or  column  effects  are  significant,  the  Tukey  k  factor  can 
again  be  used  to  determine  which  rows  or  columns  differ  significantly. 


k  (for  rows) 


k  (for  columns) 


(8.  30) 


(8.  31) 


The  factor  k  is  read  from  the  table  in  Appendix  8-A.  The  proper  degrees 
of  freedom  are  those  corresponding  to  the  degrees  of  freedom  of  the 
within  combination  source  in  the  analysis  of  variance  table,  i.  e.  ,  rc(n-l). 


(b)  Decision  Procedure,  Random  Effects  Model 

2 

In  this  model,  a  test  for  interaction,  i.  e.  ,  H:o)j  =0,  is  also 

available.  The  hypothesis  of  no  interaction,  i.  e.  ,  the  hypothesis  that 
2 

=  0  is  accepted  if 


F  = 


SS. 


ss, 


-  '  o;(r-l)(c-l),  rc(n-l) 


(8.32) 


In  this  model,  even  if  interaction  is  present,  one  can  still  test  for 

row  or  column  effects.  The  hypothesis  of  no  row  effects  (within  flight 

2 

effects),  i.  e.  ,  the  hypothesis  that  u  =  0  is  accepted  if 


F 


—  ^a;(r-l),  (r-l)(c-l) 


(8.  33) 


The  hypothesis  of  no  column  effects  (between  location  effects),  i.  e.  ,  the 
2 

hypothesis  that  (t  =  0  is  accepted  if 


A 

SS4 

^  ^a;(c-l),  (r-l)(c-I) 

SS., 


(8.  34) 
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2  2  2 

As  before,  the  quantities  <>■>  ,  c  ,  ,  and  tr  can  be  estimated,  namely 

9  Y 


A  2 


SS2  -  SS* 


n 


(8.  35) 


A  2 


3^ 

SS^  -  SS^ 
cn 


(8.  36) 


A  2 

O' 

Y 


SS4  -  SS2 


rn 


(8.  37) 


If  any  of  these  quantities  is  negative  the  estimate  is  taken  to  be  zero. 


(c)  Decision  Procedure.  Mixed  Effects  Model 

In  the  mixed  effects  model  the  row  effects  will  be  assumed  as 
the  random  effects  and  the  column  effects  will  be  assumed  as  the  fixed 
effects. 

In  this  model  a  test  for  interaction  is  also  available.  The  hypothesis 

2 

that  there  is  no  interaction,  i.  e.  ,  =0  is  accepted  if 


SS 


F  = 


SS, 


—  Q;(r-l)(c-l),  rc(n-l) 


(8.  38) 


Again,  even  if  interaction  is  present,  one  can  still  test  for  row  or  column 

2 

effects.  The  hypothesis  of  no  row  effects,  i.  e.  ,  H:«r  =  0  is  accepted  if 


♦ 

SS3 

-  ^a;(r-l),  rc(n-l) 
SS^ 

2 

An  estimate  of  <r  is  obtained  from 
9 


(8.  39) 


*  * 

SS3  -  SSj 

nc 


(8.  40) 
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The  hypothesis  of  no  column  effects,  i.  e.  ,  H:  Yj  =  Y2  “  •  •  *  ~  ~  ^ 

accepted  if 


F  = 


®'a;(c-l),  (r-l)(c-l) 


(8.41) 


The  Tukey  k  factor  is  given  by 


nr 


(8.42) 


and  can  again  be  used  to  determine  which  columns  differ  significantly. 
The  proper  degrees  of  freedom  are  those  corresponding  to  the  degrees 
of  freedom  of  the  interaction  source  in  the  analysis  of  variance  table, 

1.  e.  .  (r-l)(c-l). 


8.  4.  3  Numerical  Example 

It  will  be  assumed  that  all  measurements  were  made  at  random 
during  four  flights  which  were  selected  at  random,  at  three  specific 
locations  within  each  flight  vehicle.  Location  1  is  near  the  tail  of  the 
aircraft,  location  2  near  the  middle  of  the  aircraft,  and  location  3  in  the 
pilot's  compartment.  During  each  flight  and  at  each  location,  15  samples 
were  taken  at  random.  Three  main  flight  phases  could  be  identified  by 
visual  inspection  of  the  data  and  were  taken  to  be  1)  take-off  and  climb, 

2)  cruise,  and  3)  descent  and  landing.  It  is  desired  to  predict  the  over-all 
vibration  environment  at  those  three  locations  since  electronic  equipment 
is  to  be  installed.  Before  making  this  prediction,  the  following  questions 
have  to  be  answered: 

1.  Were  the  four  flights  statistically  equivalent  so  that  the  data 
can  be  pooled  ? 

2.  Can  one  over-all  prediction  be  made  or  should  a  separate 
prediction  be  made  for  each  of  the  three  locations? 

3.  Can  the  prediction  be  made  for  the  entire  flight  or  will  the 
flight  have  to  be  divided  into  flight  phases,  and  if  so,  how? 

If  the  answer  is  "no"  to  the  first  question,  one  can  go  no  further.  If  the 
answer  is  "yes",  questions  2  and  3  can  now  be  answered. 

The  data  is  in  terms  of  g's  rms,  each:  number  representing  the 
over-all  rms  value  of  one  sample,  two  seconds  long.  The  bandwidth 
of  the  analyzing  instrument  was  2000  cps  so  that  the  assumption  of 
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normality  for  the  distribution  of  the  rms  values  is  a  good  approximation, 
since  the  number  of  degrees  of  freedom  for  each  sample  is  quite  large. 
The  data  is  as  follows: 


Location  1; 

Flight  1:  7, 

8, 

9, 

8, 

8, 

5, 

2, 

1. 

5,  2. 

9,  2, 

4,  4.  5,  5,  4.  5,  4 

Flight  2:  8, 

7. 

9, 

7, 

8, 

b. 

2. 

5, 

2,  1. 

5,  2, 

4,  5,  4,  4.  5,  4.  5 

Flight  3:  8, 

9, 

7, 

9, 

7, 

.5, 

2. 

5, 

2.  5, 

1.  5, 

2,  3.  5,  4,  4.  5,  4. 

5 

Flight  4;  7, 

9, 

8, 

7, 

9, 

5, 

1. 

5, 

2,  2, 

2.  .5, 

4,  4,  3.  5,  5,  3.  5 

Location  2: 

Flight  1:  5, 

6, 

7. 

b, 

6, 

3, 

i. 

0. 

5,  1. 

5,  1, 

2,  2.  5,  3.  2.  5,  2 

Flight  2;  6, 

5, 

7, 

5, 

b. 

4, 

1. 

.5, 

1.  0. 

5,  1, 

2,  3,  2,  2.  5,  2.  5 

Flight  3:  6, 

7, 

5, 

7, 

5. 

3. 

1. 

5, 

1.  9, 

0.  5, 

1.  0,  2.  5,  2,  2.  5, 

2,  3 

Flight  4:  5, 

7, 

6, 

5, 

7, 

3, 

0. 

5, 

1,  1. 

1.  5, 

3,  2,  2.  5,  3,  2.  5 

Location  3: 

Flight  1:  4, 

5, 

6, 

5, 

.5, 

2. 

1, 

0. 

5,  1. 

5.,  1, 

2,  1.  .5,  2,  1.  5,  1 

Flight  2:  5, 

4, 

6, 

4, 

5, 

3. 

1. 

5, 

1,  0. 

5,  1, 

2,  2,  I,  1.  5,  I.  5 

Flight  3:  5, 

6, 

4, 

b. 

4, 

2, 

1. 

5. 

1.  5, 

0.  5, 

1.  0,  1.  5,  1,  1.  5, 

1.  2 

Flight  4;  4, 

6, 

5, 

4, 

6, 

2, 

0. 

.5, 

1. 

i.  .5, 

2,  1,  1.  5,  2,  1.  5 

For  convenience,  the  data  for  location  1  is  identical  to  the  data  used 
in  the  previous  example.  In  Section  8.  2.  it  was  shown  that  the  between 
flight  differences  were  not  significant.  A  similar  one-way  analysis  of 
variance  has  to  be  performed  for  .locations  2  and  3.  This  analysis  will 
not  be  shown  here,  but  the  reader  can  verify  for  himself  that  the 
between  flight  difference  for  locations  2  and  3  are  also  not  significant. 

The  next  step  is  to  determine  if  between  location  and  within 
flight  differences  are  significant.  Since  the  measurements  were  made 
at  random  but  the  locations  were  picked  deliberately,  a  mixed  effects 
model  will  have  to  be  used. 

(a)  Mixed  Effects  Model 

The  data  has  been  rewritten  in  tabular  form  and  is  shown  in 
Table  8.  12.  Table  8.  13  was  prepared  from  Table  8.  12,  first  computing 
within  combination  totals,  then,  computing  row  and  column  totals.  Using 
the  computational  procedure  of  Section  8.  4.  2  results  in  the  following: 
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(1)  Row  totals  are  shown  in  Table  8.  13 

(2)  Column  totals  are  shown  in  Table  8.  13 

(3)  Within  combination  totals  are  shown  in  Table  8.  13 

(4)  Over -all  total  is  shown  in  Table  8.  13 

(5)  Crude  sum  of  squares  is  obtained  from  Table  8.  12 


(6) 


(7) 


r  c  n  , 

T  f  f  X.  =  3.322.75 
i=l  j  =  l  v=l 


Crude  sum  of  squares  between  columns 
2 

151, 692.  75 


c  C. 

' 

J  =  1 


60 


=  2,528.21 


Crude  sum  of  squares  between  rows 
2 


r  R 

Z  —  = 

1=1  cn 


36,  861.  25 
12 


=  3,071.77 


(8)  Crude  sum  of  squares  between  combinations 


E  E 

i=i  j=i 


w. 


n 


13,  085.  75 
4 


3,  271.  44 


(9) 

C.  F. 

(10) 

SS4  = 

(11) 

SS3  = 

(12) 

SSj  = 

(13) 

SS  = 

(14) 

SS2  = 

-  =  ^23,  150.  25 

rcn  180 

(6)  -  (9)  =  2,528.  21  - 

(7)  -  (9)  =  3,071.  77  - 
(5)  -  (8)  =  3,  322.  75  - 
(5)  -  (9)  =  3,  322.  75  - 
SS-  SS^  -  SSj  -  SS4  = 


=  2,350.83 

2,  350.  83  =  177.  38 
2,  350.  83  =  720.  94 
3,271.44  =  51.31 
2,  350.  83  =  971.  92 
22.  29 
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Table  8.  12  Pairing  of  Locations  and  Measurements 
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Locations 

Totals 

Averages 

1 

2 

3 

1 

30.  0 

22.  0 

18.  0 

70.  0 

5.  83 

2 

33.  0 

25.  0 

21.  0 

79.  0 

6.  58 

3 

33.  0 

25.  0 

21.  0 

79.  0 

6.  58 

4 

31.  0 

23.  0 

19.  0 

73.  0 

6.  08 

5 

32.  0 

24.  0 

20.  0 

76.  0 

6.  33 

6 

21.  0 

13.  0 

9.  0 

43.  0 

3.  58 

c 

0) 

e 

7 

8.  5 

4.  5 

4.  5 

17.  5 

1.  46 

8 

8.  0 

4.  0 

4.  0 

16.  0 

1.  33 

s 

«a 

(4 

9 

7.  5 

3.  5 

3.  5 

14.  5 

1.  21 

4) 

10 

8.  5 

4.  5 

■B 

17.  5 

1.  46 

11 

15.  5 

9.  5 

■fl 

32.  5 

2.  71 

12 

17.  5 

9.  5 

5.  5 

32.  5 

2.  71 

13 

17.  0 

10.  0 

6.  0 

33.  0 

2.  75 

14 

18.  0 

10.  0 

6.  0 

34.  0 

2.  83 

15 

17.  0 

10.  0 

6.  0 

33.  0 

2.  75 

Totals 

297.  5 

197.  5 

155.  5 

650.  5 

— 

Averages 

4.  96 

3.  29 

2.  59 

— 

— 

Table  8,  13  Pairing  of  Locations  and  Measurements,  Pooling 
the  Data  of  Four  Flights  for  Each  Combination 
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From  these  values  an  analysis  of  variance  table  as  shown  in  Table  8.11 
can  be  constructed.  The  completed  table  is  shown  in  Table  8.  14. 


Source 

Sum  of 
Squares 

Degrees  of 
Freedom 

Mean.  Squares 

Between  columns 
(between  locations) 

SS.  =  177.  38 

4 

(c-1)  =  2 

«  SS 

SS.  =  — r  =  88.  69 

4  c-1 

Between  rows 
(within  flights) 

SS3  =:  720.  94 

(r-l)  =  14 

«  SS3 

SS*  =  — f  =  51.  49 
j  r-l 

Interaction 

SS2  =  2ii.  29 

(r-l)(c-l) 

=  28 

*  SSt 

SS,  =  ^  =0  80 

^  (r-l)(c-l) 

Within  Co'mbinations 
(between  flights) 

SSj  =  51.  31 

rc(n-l)=.  135 

«  SSj 

SS,  = - i =  0.  38 

^  rc(n-l) 

Total 

SS  =971.92 

rc:n-l  =  179 

SS*=  ,  .5.43 

rcn.  -  1 

Table  8.  14  Analysis  of  Variance  Table 


Choosing  a  level  of  significance  a  -  0.  03,  the  hypothesis  of  no  inter- 
2 

action,  i.  e.  ,  =  0  is  accepted  if  {fiom  Eq.  8.  38) 


SS- 


F  = 


SS 


1 


0.  80 
0.  38 


=:  if.  10  «  F 


05;  28,  135 


From  the  F  tables,  F  05.29  135  ~  therefore  the  hypothesis  is 

rejected.  In  other  words,  there  is  interaction  between  measurements  and 
locations  within  the  aircraft. 

The  hypothesis  about  between  location  effects,  i.  e.  ,  H  :  Yj  =  Y2  ~  Y3  ~  ® 
is  accepted  if  (from  Eq.  8.  41) 

*  0.80  .05,2,  Zb 


SS, 
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From  the  F  tables,  F  t  oo  =  3,  34  and,  therefore,  reject  the  hypothesis. 
In  other  words,  there  are  significant  differences  between  locations  within 
the  aircraft.  To  determine  which  locations  differ,  the  Tukey  k  factor  is 
calculated  from  Eq.  (8.  42) 


3.  50 


/O.  80" 

V  60 


0,  4 


Comparing  the  column  averages  shown  in  Table  8.  13  results  in  the  con¬ 
clusion  that  all  three  locations  differ  significantly  since  all  the  column 
averages  differ  by  more  than  0.  4.  Therefore,  a  separate  prediction 
should  be  made  for  each  location. 

The  hypothesis  about  the  between  measurement  effects,  i.  e.  , 

2 

H  ;  O' ,  =0  is  accepted  if  (from  Eq.  8.  39) 

9 


F  = 


51.  49 
.38 


135.  50  *  F 


.  05:14,  135 


From  the  F  tables,  F  05.^4  ^35  =  therefore,  reject  the  hypothesis. 

In  other  words,  there  are  significant  differences  in  the  within  flight  measure¬ 
ments. 

The  variance  cr^  can  be  estimated  from  Eq.  (8.  40)  and  is 

9 


*  ♦ 

^2  SS^  -  SSj  5j  49  _  0  3g 

cr  =  - =  -  =  4.  2d 

9  nc  12 


An  estimate  of  the  standard  deviation  of  the  within  flight  measurements 
would  be 

cr^  =V4.  27  =  2.  07  g's  rms 


Since  the  measurements  for  each  entire  flight  are  not  equivalent, 
each  flight  should  be  broken  up  into  flight  phases.  Since  this  discussion 
will  be  made  using  only  the  particular  measurements  that  were  taken,  tho 
rows  will  now  also  be  interpreted  as  fixed  effects.  This  change  in  concept 
will  allow  the  use  of  the  Tukey  k  factor  to  determine  which  rows  differ 
significantly. 
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The  mathematical  model  has  now  become  a  fixed  effects  model  and, 
therefore,  Eq.  (8.  30)  should  be  used.  From  Eq.  (8.  30) 


=  0. 18  k* 


From  Appendix  A,  since  15  effects  are  being  studied  and  SS,  has  135 

♦  ^ 
degrees  of  freedom,  k  «  4.  90.  Therefore 


k  =  (0.  18)(4.  90)  =  .  88 


Any  two  row  averages  differing  by  more  than  0.  88  are  said  to  differ 
significantly.  From  Table  8.  13,  rows  1  through  5,  7  through  10,  and  11 
through  15  are  therefore  equivalent.  A  judgment  will  now  have  to  be  made 
as  to  what  to  do  with  row  b.  This  row  will  be  considered  as  part  of 
flight  phase  2  (cruise). 

The  analysis  of  variance,  should  now  be  repeated  for  each  of  the 
flight  phases.  For  purposes  of  illustration,  phase  number  1  will  be 
chosen.  The  data  for  phase  1  is  shown  in  Table  8.  15. 

The  computational  procedure  yields  the  following: 


(1)  Row  totals  shown  in  Table  8.  15 

(2)  Column  totals  shown  in  Table  8.  15 

(3)  Within  combination  totals  shown  in  Table  8.  15 

(4)  Over-all  total  shown  in  Table  8.  15 

(5)  Crude  sum  of  squares 

c  n  f 

y  y  X  *  =■•  2,  501.  00 

i  yV 

1  J-l  V=1 

(6)  Crude  sum  of  squares  between  columns 


I 


49, 243 
20 


=  2,462.  15 


(7)  Crude  sum  of  squares  between  rows 
2 

28,487 


r  R. 

E  — 

i=l  cn 


12 


=  2,  373.  92 
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Measurements 


Locations 

1  2~ 


3 


Totals 


Averages 


Table  8.  15  Pairing  of  Measurements  and  Locations  for  Phase  1 


(10)  SS4  =  (6)  -  (9)  =  93.  33 

(11)  SS3  =  (7)  -  (9)  =  5.  10 

(12)  SSj  =  (5)  -  (8)  =  33.  75 

(13)  SS  =  (5)  -  (9)  =  132.  18 

( 14)  SS2  =  SS  -  SSj  -  SS3  -  SS4  =  0 
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The  completed  analysis  of  variance  table  is  shown  in  Table  8.  16. 


Source 

Sum  of 
Squares 

Degrees  of 
Freedom 

Mean 

Squares 

Between  columns 
(between  locations) 

SS  =  93.  33 

4 

mg 

SS4  =  46.  66 

Between  rows 
(within  flights  ) 

SS3  =  5.  10 

(r-l)  =  4 

SS*  =  1.  28 

Interaction 

SSj-  0 

(r-l)(c-l)=8 

* 

SS2  =  0 

Within  combinations 
(between  flights) 

SSj  =  33.  75 

rc(n-  1)  =  45 

SS*  =  0.  75 

Total 

SS  =  132.  18 

rcn- 1 =  59 

Table  8.  16  Analysis  of  Variance  Table 


Again  using  the  decision  procedure  for  the  mixed  effects  model,  the 
hypothesis  that  there  is  no  interaction,  i.  e.  ,  H :  O";^  =  0  is  accepted  if 


SSr 


F  = 


SS 


-  'a;8,45 


1 


from  Eq.  (8.  38).  Since  SS2  =  0»  the  hypothesis  is  accepted,  i.  e.  ,  there 
is  no  interaction. 

2 

The  hypothesis  of  no  row  effects,  i.  e.  ,  Hto*  =  0  is  accepted  if 


F  = 


SS., 


SS, 


=  1.  71  -«F  4  4C 
0.75  “  Q.4,  45 


Choosing  a  level  of  significance  a  =  .  05,  the  F  tables  show 

F  05. 4  45  =  2.  58.  Therefore,  the  hypothesis  that  there  is  no  significant 

difference  between  rows  is  accepted. 

2 

An  estimate  of  cr  is  given  by  Eq.  (8.  40),  namely, 

9 


A  2 

or 

9 


nc 


1.  28  -  0.  75 
12 


0.  044 
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An  estimate  of  a  is 

0 


=  “Y  0.  044  =  0.  21  g's  rms 


The  hypothesis  of  no  column  effects,  i.  e.  ,  H  :  \ j  =  Y2  “  Y3  =  ®  accepted 
from  Eq.  (8.  41)  if 


SS 


F  = 


SS- 


46.  66 


=  00 


a;2,  8 


(Note  that  the  term  SS2  is  actually  very  small  but  only  zero  due  to  com¬ 
putational  round-off.  The  number  46.  66/0  is,  of  course,  undefined.) 
Obviously  this  hypothesis  is  rejected.  The  Tukey  k  factor  from  Eq.  (8.  42) 
is 


Therefore,  all  three  columns'  averages  differ  significantly. 

The  over -ail  result  is  that  1)  the  flights  are  equivalent,  2)  the 
measurements  for  phase  1  are  equivalent,  and  3)  the  locations  are  not 
equivalent.  Therefore,  a  separate  over-all  prediction  for  each  location 
can  be  made,  pooling  the  data  from  ail  flights  for  phase  1.  The  reader 
should  verify  for  himself  that  similar  conclusions  can  be  reached  for 
phase  2  and  phase  3. 
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Appendix  8-A 


2 

3 

No.  of 

4 

Row  a 

5 

r  Colu 

6 

mn  Ef 

7 

;ects  I 

8 

leing  S 

9 

tudied 

10 

1 

17-97 

26-98 

32-82 

37-08 

40-41 

43-12 

46-40 

47-36 

49-07 

2 

('.-08 

8-33 

10-88 

11-74 

12-44 

13-64 

13-99 

3 

4-30 

5-91 

0-82 

7-60 

8-48 

8-85 

9-18 

9-46 

3-ri:i 

5-04 

5-76 

6-29 

6-71 

7-05 

7-35 

7-60 

7-83 

!  5 

H'd'l 

4-60 

5-22 

6-67 

6-33 

6-. 58 

6-80 

6-99 

6 

■'.-34 

4-90 

6-30 

6-90 

6-12 

6-32 

6-49 

7 

4  •  ht 

4-0,8 

6-36 

6-61 

6-82 

6-00 

6-16 

8 

■i  -,'6 

4 -04 

4-53 

4-89 

6-17 

6-77 

6-92 

9 

3-Jn 

Tv  <1.5 

4-41 

4-76 

6-24 

6-43 

6-69 

6-74 

; 

3-  i  7 

3-88 

4-33 

4-65 

4-01 

6-12 

6-46 

6-60 

i  " 

3-11 

3-82 

MM 

4-.57 

4-82 

MBSM 

5-35 

6-49 

>  12 

3-08 

3-77 

4-51 

4-75 

5-12 

5-27 

6-39 

13 

:i-()o 

3-73 

4-15 

4‘45 

4-69 

4-88 

6- Ml 

6-32 

;  M 

:!-03 

3-70 

4-11 

4-41 

4-64 

4-83 

4-99 

5-13 

5-25 

H  15 

3'(17 

4-08 

4-37 

4-59 

4-78 

4-94 

6-20 

^  16 

IMi.'i 

4-05 

4-33 

4.56 

4-74 

4-90 

5-15 

■<1  1- 

):  ' 

3-113 

4-02 

4-52 

4-70 

4-86 

4-99 

5-11 

2-iiT 

3 -(11 

4-00 

4-28 

4-49 

4-67 

4-82 

4-96 

6-07 

51 

2-iin 

3-59 

3-98 

4-25 

4-47 

4-65 

4-79 

4-62 

6-04 

20 

1  2-95 

3-58 

3-96 

4-23 

4-45 

4-62 

4-77 

4-00 

6-01 

io  24 

i  2-92 

3-53 

4-17 

4-37 

4-54 

4-68 

4-81 

4-92 

30 

1  2-89 

3-49 

3-85 

4-30 

4-46 

4-72 

4-82 

)  40 

'  2-8(1 

3-44 

3-79 

4-04 

4-23 

1  4-39 

4-52 

4-63 

4-73 

60 

2-83 

3-40 

3-74 

3-98 

4-16 

1  4-31 

4-44 

4-65 

4-66 

120 

1  2-80 

3-36 

3-68 

3-92 

4-10 

'  4-24 

4-36 

4-47 

4-66 

CC 

i 

1  0.77 

i 

3-31 

3-63 

1  3-86 

4-03 

1  4-17 

4-29 

4-30 

4-47 

1. 

1  ' 

'  \ 

>  V 

1 

11  ' 
I 

12 

No.  of 

13 

Row  a 

14 

r  Colu 

16 

[ects  I 

17 

leing  S 

18. 

tudied 

19 

20 

1 

hO-:.; 

51-90 

53-20 

64-33 

65-36 

.50-32 

57-22 

68-04 

'> 

11-30 

11-75 

15-08 

15-38 

1.5-65 

15-91 

16-14 

16-37 

.3 

;)•7l 

10-15 

10-35 

10-52 

10-09 

10-84 

11-11 

4 

•>-2l 

8-37 

8-52 

8-66 

8-79 

8-91 

5 

7-17 

7-32 

7-47 

7-72 

7-83 

7-93 

8-12 

c 

6 

0-(i.7 

0-79 

6-92 

7-14 

7-24 

7-34 

7-43 

7-51 

7-59 

Q 

7 

6-30 

0-43 

6-06 

6-76 

6-85 

6-94 

7-10 

7-17 

8 

6-05 

6-18 

6-29 

6-39 

6-48 

6-57 

6-65 

6-73 

6-87 

<0 

9 

5*87 

5-98 

6-19 

6-28 

6-36 

6-44 

0-51 

6-68 

6-64 

u 

10 

6-72 

5-83 

5-93 

6-03 

0-11 

6-19 

6-27 

6-34 

6-40 

6-47 

11 

6-61 

5-71 

6-81 

6-90 

5-98 

6-06 

6-13 

6-27 

6-33 

12 

5-61 

6-61 

6-71 

6-80 

6-88 

6-95 

6-02 

6-15 

6-21 

0 

13 

5-43 

5-53 

6-03 

6-71 

6-79 

6-80 

5-93 

6-99 

6-05 

6-11 

CO 

14 

5-30 

5-46 

6-, 56 

6-64 

5-71 

6-79 

5-85 

6-91 

6-97 

6-03 

0) 

15 

0-31 

5-40 

6-49 

6-67 

5-65 

6-72 

5-78 

6-85 

6-96 

16 

5-26 

5-35 

6-44 

6-62 

6-69 

6-66 

5-73 

6-79 

6-84 

6-90 

Qd 

17 

5-21 

5-31 

5-39 

6-47 

6.54 

6-01 

5-67 

mtm 

6-79 

6-84 

n 

IS 

5-17 

5-27 

6-35 

6-43 

6-60 

6-67 

■ISI 

6-74 

6-79 

19 

5-1-1 

5-23 

6-31 

6-39 

6-46 

6-63 

6-59 

■IS 

6-70 

5-75 

20 

5-11 

,5-20 

6-28 

6-36 

6-43 

6-49 

6-55 

6-61 

6-66 

6-71 

24 

5-01 

10 

6-18 

6-25 

6-32 

6-38 

6-44 

6-49 

6-65 

6-59, 

30 

•1-92 

5-00 

6-08 

6-16 

5-21 

6-27 

6-33 

6-38 

6-43 

6-47 

40 

4-82 

4-90 

4-98 

6-04 

6-11 

6-16 

6-22 

6-27 

6-31 

6-36 

60 

4-73 

4-81 

4-88 

4-94 

6-0(^ 

6-00 

6-11 

6-16 

6-20 

6-24 

120 

4-64 

4-71 

4-78 

4-84 

4-90 

4-96 

6-00 

^-04 

609 

6-13 

CO 

4-65 

4-62 

4-68 

4-74 

4-80 

4-86 

4-89 

4-93 

4-97 

6-01 

Table  8A- 1  Table  of  Factors  k*(5%  Significance  Level) ^  (  [l],  p,  296) 


^This  table  is  adapted  with  permission  from’ Biometrika  (1959,p.  465), 
"Upper  5%  Points  of  the  Studentized  Range"  (London:  Biometrika  Office) 
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9.  THE  RESPONSE  OF  NONLINEAR  SYSTEMS 
TO  RANDOM  EXCITATION 

9.  1  INTRODUCTION 

The  subject  of  response  of  nonlinear  systems  to  random 
excitation  has  received  some  attention  in  the  literature  only  within  the 
past  twenty  odd  years.  Because  many  physical  systems  exhibit  non¬ 
linear  behavior  and  the  assumptions  of  linearity  often  produce  large 
errors,  this  subject  is  becoming  more  and  more  important.  Most  of 
the  recent  results  are  scattered  in  many  different  technical  journals 
and  cover  several  fields  of  application.  This  report  assembles  some 
of  this  material  in  one  place  and  presents  the  reader  with  an  outline 
of  what  has  been  accomplished  to  date,  where  he  can  find  additional 
information,  and  those  areas  that  still  need  considerable  attention. 

9.2  HARDENING  SPRING - 

SINGLE  DEGREE-OF-FREEDOM  SYSTEM 

9.  2.  1  General  Theory 

Before  discussing  the  response  of  nonlinear  systems  to  random 
excitation,  a  brief  review  will  be  given  of  the  response  of  linear  systems 
to  sinusoidal  and  random  excitation  since  much  of  the  discussion  that 
follows  will  refer  to  these  cases. 

The  general  equation  of  motion  for  the  system  shown  in 
Figure  9.  1  is: 


mx  +  cx  +  F(x)  =  f  (t)  (9.  1) 

where  m  is  the  mass,  x  the  acceleration,  x  the  velocity,  c  the 
viscous  damping  coefficient,  F  (x)  the  restoring  force  in  the  spring, 
and  f  (t)  the  excitation  force. 
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f(t) 


Figure  9-  1  Single  Degree -o£-Freedom  System 
With  Force  Applied  to  the  Mass  m. 


If  the  motion  is  applied  to  the  base,  as  shown  in  Figure  9.^  the  equation 
of  motion  becomes 

mz  +  CZ  +  F(z)  =  -mu  (9.  2) 

where  z  =  x  -  u  is  the  relative  motion  between  the  base  and  the  mass  m. 


Figure  9.  2.  Single  Degree-of-Freedom  System 
With  Motion  Applied  to  the  Base. 
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where  |H(w)|  is  the  magnitude  response  function,  or  magnification  factor, 
as  defined  by  Ref.  [l5,  p.  2-9  ]. 


(9.6) 


If  the  input  is  given  as  an  acceleration  u  =  Uq  sin  cot,  then  the  accelera¬ 
tion  of  the  mass  m  is 


X  =  T  ii 


(9.  7) 


and  the  relative  acceleration  is 


z  = 


H(u)) 


(O 


CO 


(9.  8) 


n' 


If  it  is  de'jired  to  obtain  the  relative  displacement  z  when  the  input  is 
given  in  terms  of  the  acceleration  ii  then  the  relationship  becomes 


where 


is  given  by  Ref.  15, 


(9.9) 


1a(w)|  = 


CO  \ 

"  \ 


1  - 


CO 


2.  2 


CO 


CO 


CO 


n 


|h((o)| 

CO 


(9.  10) 


It  should  be  noted  that  for  the  system  shown  in  Figure  9.1  the  absolute 
amplitude  x  of  the  mass  m  is  equal  to  the  relative  amplitude  z  since 
the  base  is  stationary  (i.  e.  ,  u  =  0).  If  a  force  f(t)  =  =  Fq  sin  cot  is 
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The  system  described  by  Eq.(9.  l)will  be  a  linear  system  if  and 
only  if  F(z)  =  kz  where  k  is  a  constant,  and  m  and  c  are  also  con¬ 
stants.  In  the  next  section  9.  2.  Z  F(z)  will  be  assumed  to  have  this 
linear  form.  In  the  following  section  9.  2.  3,  F(z)  will  be  assumed  to 
satisfy  a  nonlinear  relation  F(z)  =  k  z  +  r  z  . 


9.  2.  2  Linear  System 
Sinusoidal  Input 

If  the  restoring  force  in  the  spring  of  the  system  in  Figure  9.  2 
given  by  F(z)  =  kz  and  the  motion  of  the  base  is  a  displacement 
u  =  Uq  sin  ojt,  then  the  absolute  displacement  x  of  the  mass  m  (ignoring 
phase)  is  given  by 


X  = 


=  -^U 


(9.3) 


where  is  the  transmissibility  as  defined  by  Ref.  ^15,  p.  Z-lsj. 


(9.4) 


Here 


and 


The  relative  displacement  z  is  given  by 


z  = 


u 


(9.5) 
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applied  to  the  mass  m  in  Figure  9.  If  the  force  transmitted  to  the  foun^ 
dation  F,^  is  given  by 

F„=  TF.  (9.  11) 

T  r  1 
r 

where  is  as  defined  in  Eq.(9.  4).  The  displacement  x  will  then  be 


Fj  i  IhM 


(9.  12) 


and  the  acceleration  x  will  be 


x=Fi  ~  |H(o,) 

where  |h(o))|  is  as  defined  by  Eq.(9.6). 


(9.  13) 


Random  Inputs 

When  the  input  u  in  Figure  9.  2  is  random,  the  output  displace¬ 
ments  X  and  z  can  be  calculated  easily  if  C  is  small  <C  0.  1)  and 
the  input  power  spectral  density  G^lu),  defined  for  positive  frequencies 
only,  is  relatively  constant  in  the  neighborhood  of  the  natural  frequency 
of  the  system.  See  Figure  9.3.Rrf.[ll,  p.  85]. 


G(w) 


Figure  9.  3.  Typical  Input  Power  Spectrum  and  Frequency 
Response  Function  vs.  Frequency. 
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If  one  lets  Gq(w)  be  the  output  power  spectrum,  then  the  general 
relationship  is  Ref.  |  8,  p.  Szj  . 

G^(c»)  =  |h(w)|^  G.(w)  «|H(a))|^  G.(w^)  (9.  14) 

where  G^(oj)  has  been  replaced  by  a  constant.  This  is  justified 

when  jH(a))j  has  a  sharp  resonance  at  as  shown  in  Figure  9.  3.  If  the 
input  IS  an  acceleration  power  spectral  density,  then  the  output  is  also 
in  terms  of  acceleration  density  and  represents  the  power  spectral 
density  of  the  relative  acceleration. 

If  the  displacement  output  power  spectrum  is  desired,  when  the 
input  is  an  acceleration  power  spectrum,  then  the  transfer  function  |A(w] 
as  defined  in  Eq.(9.  10)  has  to  be  used.  In  place  of  Eq(9.  14),  one  obtains 

G^d^")  =  |a(w)|^  Gia^^’n^ 

where  G^j(w)  is  the  output  displacement  power  spectral  density  and 
Gial*'’)  the  input  acceleration  power  spectral  density. 

The  mean  square  output  displacement  (relative)  is  now  given  by 


(9.  16) 


If  the  input  power  spectrum  G.^  is  given  in  terms  of  cps  rather  than 

radians  per  seconds,  let  G.  (f)  =  ZwG.  (w),  and  Eq{9.16)  becomes 

la  la 


8C  u  ^ 

n 


(9.  17) 
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The  mean  square  output  acceleration  is  obtained  by  the  use  of  |H(<t>)|  in 
Eq.(9.16),  which  results  in 


..2 

z 


it(<>  G.  (u  ) 
n  la  n' 


44 


C.  (f  ) 

n  la'  n' 


84 


(9.  18) 


If  the  input  is  given  in  units  of  force  squared  per  radian 

to  the  mass  m  in  Figure  9.  1,  the  output  displacement  power  spectral 

density  is 


°od<"'=  <’•*’> 

k 

The  mean  square  output  displacement  is  then 


2 

z 


ww  G._(w  ) 
n  iF  n' 


44  k 


2 


n  ir  n 


84  k‘ 


(9.  20) 


Another  parameter  of  interest  is  the  probability  density  of  instan¬ 
taneous  amplitudes.  If  the  input  is  Gaussian,  the  output  will  also  be 
Gaussian  and  the  density  function  is  given  by 


.  -z^/2a‘’ 

p(z)= - (9.21) 

vyZn 

where  =  z^  and  the  mean  response  z  is  assumed  to  be  zero. 

The  response  of  a  lightly  damped  (4'*0.  1)  single  degree-of-freedom 
system  when  subjected  to  rauidom  excitation  is  shown  in  Figure  9.  4.  The 
response  curve  represents  a  quasi- sine  wave  with  frequency  at  approxi¬ 
mately  and  a  randomly  varying  amplitude.  The  average  number 

of  zero  crossings  per  unit  time  would  then  be 


Ui 


(9.  22) 
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The  probability  that  z  will  exceed  a  specified  value  is  determined  by 


where  erfc  denotes  the  complementary  error  function  and  the  approxi¬ 
mation  holds  for  z^  ^  a.  Equation  (9-  25)  can  be  used  to  determine  the 
probability  of  exceeding  some  ultimate  stress  (in  terms  of  z^),  whereas 
the  Rayleigh  distribution  can  be  used  for  fatigue  studies  since  then  the 
probability  distribution  of  peaks  is  of  importance. 

9.  2.  3  Nonlinear  System,  Wide-Band  Excitation 

The  previous  discussion  has  shown  that  the  analysis  of  linear 
systems  can  usually  be  made  without  simplifying  restrictions  and  exact 
solutions  can  be  obtained  for  many  parameters  as  long  as  the  physical 
system  is  governed  by  the  assumed  equations  of  motion. 

For  nonlinear  systems  the  situation  is  much  less  satisfactory. 
Even  when  a  nonlinear  system  can  be  described  exactly  by  its  differential 
equation  of  motion,  exact  solutions  cannot  usually  be  obtained.  One  is 
therefore  saddled  with  two  levels  of  approximation.  First,  the  differential 
equation  represents  an  approximation  to  the  actual  system  under  study, 
and  second,  one  has  to  use  approximate  methods  to  solve  the  equations. 

Prior  to  obtaining  any  analytical  solutions  one  can  deduce  in  a 
qualitative  manner  what  characteristics  the  response  amplitude  should  have. 
Considering  the  single-degree-of-fr eedom  system  as  a  narrow-band 
oscillator,  the  response  of  a  linear  system  is  essentially  that  of  a  modulated 
sine  wave  oscillating  at  the  natural  frequency  of  the  system.  For  a 
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hardening  spring  one  would  therefore  expect  an  increase  in  this  fre¬ 
quency  and  a  decrease  in  the  probability  of  large  amplitudes  by 
flattening  of  the  peaks  due  to  the  continuous  increase  in  stiffness  of  the 
system  for  increasing  deflections.  The  discussion  that  follows  will 
bear  out  these  intuitive  results. 

To  date,  mostly  two  methods  have  been  applied  to  the  single 
degree-of-freedom  system  with  a  nonlinear  restoring  force.  They  will 
be  discussed  below,  followed  by  a  comparison  of  the  two  methods. 

(a)  Exact  Solution 

The  first  method  uses  the  Fokker-Planck  equation  to  obtain 
the  joint  probability  density  for  the  response  velocity  and  displacement 
Ref.  2oj  . 

From  Eq.  (9.  2), 

m'z  +  c  z  +  F  (z)  =  -m  li 

Dividing  by  m,  letting  O'  =  ,  and  -u  =  A  (t) 


z  +  2q'  z  +  —  F  (z)  =  A(t) 
m 


(9.26) 


If  the  random  input  A(t)  is  considered  as  an  infinitely  dense  super¬ 
position  of  independent  infinitesimal  impulses,  the  joint  probability 
density  of  displacement  and  velocity  of  the  response,  p  (z,  z),  can  be 
obtained  by  solving  the  Fokker-Planck  equation,  Ref.  [20I  . 


9t  9  z 


9  •  X  1 

—  2q'z  +  — 

9  z  [_  m 


F  (z) 


-  S  (f  )  ^ 
2  "  9i 


(9.27) 


where  S^^(f^)  is  the  acceleratiqn  power  spectral  density  of  A(t)  over 
both  positive  and  negative  frequencies  in  terms  of  cps.  Assuming  the 
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input  has  been  present  since  t  =  -oo.one  can  let  dp/dt  =  0  and  obtain, 

Ref.  [20]. 


where  C 
requiring 


p (z,  z)  =  C  exp 


lieL_(z^+  -ifF(z)  dz) 

Sjf)  mJ 


(9.  28) 


is  a  normalizing  constant  which  can  be  determined  by 


p(z,  z)  dz  dz  = 
-00 


1 


(9.  29) 


Nonlinear  Cubic  Elasticity  Case  (Hardening  Spring) 

Mindlin,  Ref.  ,  has  given  equations  for  several  types  of 
hardening  springs.  The  main  type  analyzed  to  date  has  been  the  cubic 
elasticity  equation  which  is 


F(z)  =  k  z  + 


3 

r  z 


(9.  30) 


where  k  is  the  initial  spring  constant  and  r  determines  the  rate  of 
increase  of  z.  Both  Mindlin,  Ref.  ^ZsJ  ,  and  Klein,  Ref.  |l7|  , 
have  given  examples  for  the  evaluation  of  k  and  r  from  experimental 
data.  Equation  (9. 30)i s  plotted  in  Figure9.5.  Since  F(z)  is  an  odd  func¬ 
tion  of  z,  even  powers  of  z  are  not  present. 
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Figure  9.  5.  Cubic  Elasticity  Force  -  Deflection  Curve 

3 

F(s)  =  k  z  +  r  z 


The  material  to  follow  in  Section  9.  2.  3  applies  only  to  this 

special  type  of  nonlinearity  exhibited  by  Eq.  (9.  30). 

k  *  2  k 

Letting  r  =  — j-  and  w  =  —  .  one  can  write 


m 


F(z)  =  w 


2 

n 


(9.31) 


Substituting  Eq(9.31)  into  Eq.(9.28)  and  integrating  the  exponent  one  gets 


p(z,  z) 


C 


Za 


la  n 


+ 


The  parameter  i  was  chosen  for  convenience  since  for  the  analysis  of 
pinned  beam,  I  is  equal  to  twice  the  radius  of  gyration  of  the  beam's 
section. 
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Since  S.  (f)  was  defined  such  that  both  negative  and  positive 
frequencies  contribute  to  the  total  mean  square  (i.e.,  G.  (f)  =  2S.  (f)), 

1  ct  1  & 

one  obtains  from  Eq.  (9.  17) 


2 


4t.w 


(9.  33) 


n 


where  is  the  mean  square  displacement  if  the  system  were  linear, 

2  ~2. 

(i.  e.,  =  z  ).  It  is  often  convenient  to  use  a  dimensionless  response. 

Let 


I  2 


and 


4  = 


h> 


n 


Eq(9.33)  becomes 


S.  (f  ) 

la  n 


2  2 

‘‘“"n  ' 


(9.  34) 


Substituting  for  S.  (f  )  in  Eq.(9.32),  and  since  p  (z,  z)  can  be  factored 

X  ci  IX 

in  terms  of  z  and  z  making  z  and  z  statistically  independent,  one 
can  write 


p(z,  z)  =  p{z)  p(z)  =  C  exp 


.2 
-  z 

exp 

(l  t 

2  2.2 

~  ^  "  21 

2a  j  u)  t 

^  d  n 

2(r^  i  \  2  i  /_ 

(9.  35) 

It  is  convenient  to  express  the  displacement  z  in  terms  of  a 

normalized  displacement  y  =  —  .  Equation  (9.  35)  then  becomes 

i 


p(y)  p(y)  =  c  exp 


2or 


2  2l 


(9.  36) 


ASD  TDR  62-973 


9-13 


After  solving  for  C  (involving  numerical  integration),  it  has  been 

shown  that  the  velocity  y  is  then  normally  distributed  with  mean  value 

zero  and  variance  (o-.u)  )^,  Ref.  [  2ol  ,  namely, 

an 


p(y)  = 


yZir  ff  jO) 
d  n 


exp 


.  2 

-y 


,22 
ia  ,  u)  , 
d  n  J 


(9.  37) 


The  displacement  y,  however,  has  the  distribution.  Ref.  [24|  , 


p(y)  = 


CJ  <T  , 

n  d 


exp 


Za 


(9.  38) 


ri+ 


where  ]Jq  is  the  number  of  zero  crossings  with  positive  slope  and 
defined  by  the  equation.  Ref.  ^9]. 


V 


*  =  I*  i  p(0. 


z)  dz  =  C 


la  n 
4a 


(9.  39) 


if  it  is  assumed  that  maxima  occur  only  for  values  of  z=»0  and  minima 

occur  only  for  values  of  z««  0.  The  quantity  can  also  be  interpreted  as  an 

"average  resonant  frequency"  for  the  nonlinear  system  if  a  is  small. 

The  ratio  f  /  ,  where  f  =  w  /2it  is  the  linear  natural  frequency 

n  u  n  n 

obtained  by  letting  f(z)  =  kz,  has  been  evaluated  by  Lyon,  Ref.^24j  , 

for  various  values  of  the  linear  mean-square  response  and  is  shown  by  the 

solid  line  in  Figure  9.  6,  obtained  from  Ref.  [^o]- 

Figure 9.  bindicates  the  expected  increase  in  with  an  increase 
of  the  input.  The  increase  of  the  resonant  frequency  of  such  a  nonlinear 
system  when  subjected  to  sinusoidal  excitation  is  indicated  by  the 
dashed  line  in  Figure  9.  6,  obtained  from  Ref.  [zo]. 
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d  '  (  4  a  2/2  )  ^io 


Figure  9.  6.  Ratio  of  Linear  Natural  Frequency  to  Nonlinear 

"Average  Resonant  Frequency"  vs.  the  Normalize 
Linear  Mean-Square  Displacement  Response, 


PHASE 

ANGLE 


Figure  9.  7.  Waveform  of  Nonlinear  Carrier  Compared 
to  a  Sine  Wave 
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Lyon,  Ref.  20j  ,  has  also  calculated  the  shape  of  the  carrier 
wave  and  the  general  result  is  shown  in  Figure  9.  7  which  indicates  the 
expected  flattening  of  the  amplitude  peaks.  It  is  beyond  the  scope  of  this 
report  to  discuss  the  analytical  solution  and  the  reader  is  referred  to  the 
references.  For  a  discussion  of  probability  density  of  peaks,  see 
Section  9.  3. 4. 

A  curve  of  the  ratio  of  nonlinear  to  linear  mean-square  response 
versus  the  linear  mean- square  response  (which  is  a  function  of  the  input 
power  spectrum)  is  shown  in  Figure  9.8,  Ref.  [zi]. 


Figure  9.8.  Ratio  of  Nonlinear  to  Linear  Mean-Square 

Response  vs.  Linear  Mean-Square  Response 

“2 

This  result  is  obtained  from  the  exact  solution  of  y  using  the 
probability  density  of  p  (y)  of  Eq.  (9.  38),  namely 
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(b)  Approximate  Solutions 

In  order  to  avoid  the  tedious  job  of  numerical  integration, 
approximations  can  be  made  in  the  original  differential  equation  which 
result  in  much  simpler  methods  of  solution.  One  of  the  most  widely 
used  is  the  method  of  "Equivalent  Linearization'.'  See  Ref. ^4j. 

Substituting  Eq.(9.31)  into  Eq.(9.26),  one  obtains 


z+  2az  +  u)^^(z  +  —  )  =  A(t) 

f  ^ 


(9.41) 


Normalizing  z  by  letting  ^  ~  y  ’  write 


y  +  2ay  +  (  y  +  y^)  =-  A'(t) 


(9.  42) 


Adding  the  term  \y  to  both  sides,  Eq.  (9.42}  can  be  written 


y  +  2  ay  +  Ay  =  A'(t)  -  y  +  y^)  +  Ay  (9.  43) 


where 


-  w  (  y  + 


y^  + 


Ay  =  R 


(9.44) 


is  called  the  remainder  term. 

If  the  remainder  is  neglected,  one  has  a  linear  equation  which 
results  in  a  mean  square  response. 


2 

y 


Si.(f  ) 

la  n 


4a  A.f 


(9.  45) 


It  will  now  be  assumed  the  can  be  neglected  if  the  expectation 

E  minimized  by  a  proper  choice  of  A-  Lyon,  Ref.  ^2lj  ,  gives 

the  proper  chpice  as 

A  =  (I  +  3y^  (9.46) 
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Substituting  Eq.  (9.  46)  into  Eq.  (9.  45)  results  in 


~2  1 

y  - 


'(1  + 


(9.  47) 


“?/  2  . 


The  ratio  y  is  plotted  versus  the  linear  mean  square  response 

(which  is  a  function  of  the  input  power  spectrum)  in  Figure  9-  9  and  is  also 
compared  to  the  exact  solution.  As  can  be  seen  from  Figure  9-  9,  the 
approximation  is  quite  good  resulting  in  errors  of  less  than  10%. 

Lyon,  Ref.  j^2lj  ,  also  calculated  the  "average  resonant  frequency" 
using  this  approximation  and  the  results  are  shown  in  Figure  9.  10. 

Figure  9.  10  shows  that  even  for  small  values  of  the  input,  the 
approximation  is  quite  poor  and  it  would  be  better  to  estimate  the 
"average  resonant  frequency"  of  the  nonlinear  system  by  f^. 

Crandall,  Ref.  |^9j,  has  recently  used  a  different  approach  in 
calculating  U ^  by  approximate  methods  which  agrees  much  more  closely 
to  the  exact  solution.  He  uses  the  method  of  equivalent  linearization  to 
obtain  the  free  vibration-amplitude  relation  and  then  finds  the  average 
frequency  of  the  random  response  by  statistically  averaging  these 
frequencies  using  the  probability  density  of  the  amplitudes. 


9.2.4  Nonlinear  System,  Narrow-Band  Excitation 

One  of  the  well  known  characteristics  of  nonlinear  single 
degree-of-freedom  systems  subjected  to  sinusoidal  excitation  is  the 
"Jump  Phenomena."  This  is  illustrated  for  the  case  of  hardening 
spring  in  Figure  9.  11. 
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Figure  9.9.  Comparison  of  Exact  and  Approximate  Solution 
of  the  Mean>Square  Response,  Ref.  [20]  . 


Figure  9.10.  Comparison  of  Exact  and  Approximate  Solution 
of  the  Ratio  of  Linear  Natural  Frequency  to 
"Average  Resonant  Frequency" 
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Figure  9.  11.  Response  of  Nonlinear,  Damped,  Single  Degree- 
of-Freedom  System  to  Sinusoidal  Excitation. 

As  the  frequency  is  slowly  increased  from  zero  cps,  the  trans- 
missibility  increases  from  1  to  D  and  to  A  and  then  "jumps"  out  of 
resonance  to  point  B.  If  resonance  is  approached  from  the  region 
above  resonance  by  slowly  decreasing  the  frequency,  the  transmissi- 
bility  increases  from  B  to  C  and  then  "jumps"  into  resonance  to  point  D 
and  then  decreases  to  1  at  zero  frequency.  It  should  be  noted  that  the 
region  CA  is  unstable  and  therefore  cannot  represent  the  trans- 
missibility  of  a  physical  system  at  any  time. 

Such  a  behavior  does  not  seem  to  appear  when  the  input  is 
described  by  a  wide-band  random  process  and  it  can  be  demonstrated 
that  such  multi-valued  behavior  cannot  exist  when  the  excitation  is  wide¬ 
band.  What  is  required  is  a  source  that  can  exchange  energy  with  the 
system  over  several  cycles  in  order  that  more  than  one  stable  state 
can  exist  consistent  with  the  equations  of  motion.  This  argument 
suggests  that  a  random  input  that  correlates  with  itself  and  therefore 
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with  the  response  over  several  cycles  would  produce  the  same  effect. 
That  this  is  so,  has  been  shown  by  Lyon,  Heckl,  and  Hazelgrove, 

Ref.  and  a  brief  discussion  of  their  method  follows. 

First,  the  magnitude  response  function  of  the  nonlinear  system 
is  calculated  by  the  use  of  Buffing's  method,  see  Ref.  |36j.  Then  it  is 
assumed  that  the  nonlinear  system  is  driven  with  the  output  of  a  narrow 
band  linear  filter  which  in  turn  is  driven  by  a  wide  band  random  process. 
The  power  spectrum  of  the  response  can  then  be  calculated  as  follows: 


H(")/  Gj(c„) 


(9.  48) 


where  |h{oj)j^|  is  the  magnitude  response  function  of  the  linear  narrow- 
band  filter  and  |h(w)j^|  is  the  magnitude  response  function  of  the  non¬ 
linear  system. 

The  results  are  plotted  in  Figure  9.  12  and  compared  to  the  response 
curves  for  sinusoidal  excitation.  The  symbols  are  defined  as  follows: 


=  linear  natural  frequency  of  single  degree -of-freedom  system 
u)j  =  center  frequency  of  narrow- band  filter 
Bi/2=  half  bandwidth  of  narrow- band  filter 

0"^^  =  mean  square  value  of  output  of  filter  (input  to  nonlinear 
system),  normalized 

~2 

y  =  mean  square  value  of  response,  normalized 


The  fraction  of  critical  damping  t,  in  the  system  excited  by  sinu¬ 
soidal  excitation  is  .  05  and  in  the  system  excited  by  narrow-band  random 
excitation  is  "very  small"  (i.  e.  ,  4  ^  •  05)  but  not  specified. 
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Figure  9.  12.  Comparison  of  Theoretical  Response  For 

Sinusoidal  (solid)  and  Narrow-Band  (dashed) 
Excitation  for 

— 2^ —  =  100  (filter  very  narrow) 

®l/2 

where  a  =  u)  ^  . 


The  similarity  oi  the  curves  in  Figure  9.  12  to  the  curve  ir 
Figure  9. Ucan  be  seen  immediately.  Their  shapes  differ  somewhat 
mainly  because  Figure  9. i2j.sa  log -log  plot,  v/hereas  Figure  9.  11  plots 
the  relationship  of  T  and  f  directly.  However,  an  interesting 
question  arises  here,  namely,  how  much  time  is  spent  in  each  of  the 
three  possible  amplitude  regions  during  random  excitation.  For  the 
sinusoidal  case  it  is  known  that  the  region  CA  (Figure  9.11)  is  unstable 
and  the  system  can  spend  all  of  its  time  either  along  DA  or  CB,  depend¬ 
ing  on  how  the  operating  point  is  approached.  For  the  random  input,  the 

operating  point  probably  changes  constantly  but  how  this  change  takes 
place,  or  how  much  time  is  spent  at  each  operating  point  is  not  known 
at  this  time. 
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HARDENING  SPRING  — 
CONTINUOUS  STRUCTURES 


9.  3 


When  considering  the  results  of  analyses  for  the  response 
of  continuous  structures,  one  observation  can  be  made  immediately. 
Namely,  even  for  sinusoidal  excitation  the  analytical  results  are  often 
poor  appr  .ximations  when  compared  to  experimental  data.  This  is 
due  to  the  very  limited  knowledge  about  the  mechanism  of  structural 
damping.  It  is  known  that  for  many  structures  the  damping  is  of  a 
nature  which  results  in  coupling  of  the  various  modes  of  vibration, 
i.  e.  ,  the  participation  of  the  structure  in  one  mode  is  dependent  upon 
its  participation  in  all  other  modes.  The  nature  of  this  dependence  is 
not  known  and  unless  simplifying  assumptions  are  made,  the  equations 
of  motion  cannot  be  solved.  The  usual  assumption  made  for  struc¬ 
tural  damping  is  that  it  is  in  phase  with  the  velocity  and  proportional 
to  the  generalized  displacement  of  each  mode. 

9.  3.  1  General  Theory 

Before  discussing  nonlinear  structures,  a  brief  review  will 
be  given  for  the  analysis  of  linear  structures.  Such  a  structure  has 
certain  normal  mode  properties  and  because  of  the  orthogonality  of 
these  normal  modes  it  can  be  assumed  that  the  response  of  each 
individual  mode  is  independent  of  the  response  in  all  the  other  modes. 

The  total  displacement  response,  using  the  principal  of  super¬ 
position,  is  then  simply  the  sum  of  the  individual  mode  displacements. 
In  terms  of  the  normal  modes,  the  total  response  is 

u(x,  y,  z,  t)  =  ^  q^(t)  y.  z)  (9.  49) 

n 
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where  ^^^(0  is  the  generalized  displacement  as  a  function  of  time  and 
0^(x,  y,  z)  the  mode  shape  of  the  nth  mode.  To  obtain  y.  z) 

several  approaches  can  be  used.  One  of  these  is  the  Rayleigh-Ritz 
method,  Ref.  |^15,  p.  7-3]  ,  where  a  mode  shape  is  assumed  initially, 
and  written  in  the  form  of  a  series  with  arbitrary  constants.  Solution 
of  the  Lagrange  equations  using  this  assumed  mode  shape  will  then 
result  in  values  for  these  arbitrary  constants  that  will  give  the  best 
approximation  to  the  actual  mode  shape. 


9.3.2  Linear  System 

Making  the  assumption  for  structural  damping  as  dis¬ 
cussed  above,  let 

(9.  50) 


Y  =2  t - 

n 


The  Lagrange  equations  of  the  system  will  then  have  the  form,  see 
Ref.  [l5,p.  11-11 

Yn  2  2 

TT  "n  ^"-n  '^n= -  <9.51) 


where 


M. 


n 


0)  = 
n 


M 


Q„(t)  = 


structural  damping  coefficient 
nth  normal  angular  frequency 


0  (x,  y,  z)  m(x,  y,  z)  dx  dy  dz  =  generalized  mass 

r 

F(x,  y,  z,  t)  y,  z)  dx  dy  dz  =  generalized  input  force 


The  generalized  mass  and  input  force  can  be  obtained  by  integrating  over 
the  structure. 
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If  a  sinusoidal  force  is  applied,  one  obtains 


Qn(^)  =  J F(x,  y,  z)  y.  z)  dx  dy  dz  =  e^“^ 


w  w 
o  n 


(9.52) 


where 


and 


w 


=  Jf(x,  y, 


z)  dx  dy  dz  =  amplitude  of  total  applied  force 


w 


'  =  -  /F(x,  y.  z)  0„(x,  y,  z)  dx  dy  dz  =  mode 

n  w  / 

o 

participation  of  the  applied  force 

The  steady- state  solution  for  Eq.{9.51)is  straightforward,  resulting  in 


jcjt  je 


w  w  e  e 
o  n 


n 


'  2 

/  CO  \  2l 

2  2 

M  CO  ^ 
n  n  \ 

['  -H 1 

+  Y 
'n 

(9-53) 


Substituting  into  Eq.(9.49)  results  in  a  total  displacement  of  the  structure 

je. 

\1/  ^  i  ^  pm\  A 


^n^n^x.y.z)  e 


u  =  w  e 
o 


"  M  u> 


^  ■  (“n) 


b>  \  2i2  2 

+  Y, 


(9.  54) 


'n 


The  square  of  the  magnitude  response  function,  defined  here  as  the  ratio  of 
output  displacement  to  input  force  can  now  be  determined  from  Eq..  (9.  54), 
and  one  obtains 


A(w) 


■y  ■  5 


n  n 


I  - 

!il 

■ 

2 

+ 

1 

•  n  >  J 

J 

(9.55) 


The  solution  for  the  response  to  random  excitation  can  now  also  be  found 
very  easily  by  the  use  of  Eq.  (9.  16).  This  results  in  a  mean  square  dis¬ 
placement  response 

14  - r~3 - 

"  Y  M  u 

n  n  n 
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Eq^9.56)  will  reduce  to  Eq.(9.20)  if  only  the  first  mode  is  assumed  to 

participate  in  the  response  and  the  structure  is  considered  as  a  lumped 

mass  with  an  equivalent  spring  constant  k.  Since,  then,  4^  (x,  y,  z) 

M  ^  =  m^  =  k^/cj  ^ ,  y  -  ,  and  —  ^  I 

n  n  n 

n  n 

9.3.3  Nonlinear  System 

As  has  been  shown  above,  a  set  of  independent  uncoupled 
modes  can  be  used  to  describe  the  response  of  linear  structures.  This 
is  not  the  case  for  nonlinear  structures.  For  example,  consider  the 
case  of  a  pinned-pinned  beam. 


Figure  9.13.  Pinned -Pinned  Beam 


First,  Eq  (9.51)can  be  rewritten  as  follows: 


M  q+R  q+K  q  =  Q(t) 

n  n  n  n 


(9.  57) 


where  is  the  generalized  damping  resistance  and  the  generalized 

stiffness.  The  particular  Lagrange  equation  for  the  pinned  beam  can  be 
derived  from  the  kinetic  and  potential  energies  just  as  in  the  linear  case. 
However,  the  generalized  stiffness  derived  from  the  potential 
energy  will  now  exhibit  some  major  differences.  The  stiffness  for  the 
ith  mode  will  now  have  the  following  form,  see  Ref.  34,  p.  sj 

V"  2  2 

L  "  'In 


K.  =  K. 

1  lO 


I  (- 


•2  ,2 
1  t 


(9.  58) 
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where  i  is  the  characteristic  length  equal  to  twice  the  radius  of 
gyration  of  the  beam's  section.  This  clearly  indicates  the  coupling 
of  the  modes  and  that  the  response  of  one  mode  will  require  considera¬ 
tion  of  the  response  in  all  other  modes. 

The  damping  term  also  adds  to  this  problem.  As  for  the 

linear  case,  insufficient  knowledge  exists  as  to  the  exact  nature  of 
the  damping  mechanism.  In  addition,  in  the  nonlinear  case,  even  if 
the  damping  mechanism  is  linear,  the  damping  resistance  is  non¬ 

linear,  see  Ref.  [^sj.  The  result  of  these  difficulties  is  that  the 
equations  of  motion  for  an  exact,  or  even  almost  exact,  mathematical 
model  for  a  damped  nonlinear  structure  have  not  been  solved  to  date. 
Therefore,  most  analyses  made  in  recent  years  usually  assumed 
1)  linear  damping,  and  2)  response  only  in  the  first  mode  using  a  lumped 
mass  and  equivalent  spring  constant.  This  type  of  system  has  been  dis¬ 
cussed  in  Sections  9.  2.  3  and  9.  2.4.  However,  some  experimental  results 
are  available  and  will  be  discussed  below. 

Lyon  recently  published  data  from  an  experimental  study  of  a 
clamped-clamped  beam  subjected  to  narrow- band  random  excitation, 

Ref.  |23j(also,  see  Section  9.2.4  for  theoretical  discussion).  The  funda¬ 
mental  resonance  was  placed  at  75  cps,  the  bandwidth  at  resonance  was 
10.  5  cps,  and  the  Q  of  the  beam  was  7.  15  The  output  of  the  random 
noise  generator  was  filtered  using  an  8%  bandwidth  setting.  The 
experimental  results  are  shown  in  Figure  9.  14(a),  (b),  and  (c),  and  are 
compared  to  theoretical  results  based  on  the  single  degree -of-freedom 
model.  It  should  be  noted  that  the  damping  for  the  theoretical  curves 
was  small  (i.  e.  ,  ^  <$C  .  05)  However,  all  other  parameters  were  the 
same  as  those  for  the  experimental  model. 
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The  agreement  with  theory,  as  indicated  by  Figure  9.  14,  is  not  good. 
Particularly  the  jump  phenomena  (Figure  9.  14(c))  occurs  at  a  much  lower 
frequency  than  that  predicted  by  theory.  This  may  be  due  to  the  large 
difference  in  damping  between  the  two  cases  or  other  factors,  such  as 
nonlinear  damping,  and/or  higher  mode  participation. 


9.  3.  4  Fatigue 

Another  topic  of  interest  in  the  analysis  of  response  of  structures 
is  the  fatigue  characteristics  of  the  structure.  There  are  three  additional 
parameters  which  now  have  to  be  considered.  These  are  the  probability 
density  of  peaks,  the  displacement- strain  relationship,  and  the  probability 
density  of  stress  maxima.  In  order  to  determine  these  parameters  it  was 
assumed  that  the  response  occurred  only  in  the  first  mode  and  the  beam 
was  replaced  by  an  equivalent  spring  constant  and  a  lumped  mass. 
Therefore,  the  accuracy  of  the  results  should  be  eyed  with  suspicion. 

The  probability  density  of  peaks  is  given  by  Ref.  [  2o| 


p  (y) 


=  y(^  +  y  ) 


exp 


‘4 


2  or 


(9.59) 


remembering  that  y  and  cr^  are  normalized  with  respect  to  the  character - 

O' 

Z  I* 

istic  length  f  (i.  e.  ,  V  -  y  now  is  convenient  to  normalize 

the  characteristic  length  I  and  the  displacement  z  with  respect  to  the 


root-mean- square  response  o-^.  Defining  ~ 
Eq.  (9- 59)  becomes.  Ref.  j^52j. 


^  and  i  =  — , 
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P  (z  ) 
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n  n 
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2^1 


exp  I  -z 
^  I  n 
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yj 


(9.  60) 


The  probability  density  of  peaks  p(z  )  for  i  =  8  is  shown  in 


Figure  9-  15,  obtained  from  Ref.  [34]. 


n 


n 
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Figure  9.  15.  Density  of  Peaks  of  a  Linear  and  Nonlinear 
Single  Degree-of-Freedom  System  for  i^=  8. 

As  discussed  earlier.  Figure  9.  15  also  indicates  that  the  probability 
of  high  peaks  occurring  with  a  relatively  large  input  is  less  for  the  non¬ 
linear  than  for  the  linear  system. 

The  following  assumptions  are  made  in  Ref.  j^32| .  Fatigue  damage  is 
cumulative  and  the  fractional  damage  contributed  by  any  one  response 
peak  is  a  function  of  the  peak  amplitude  of  strain  only.  The  damage 
contributed  by  a  single  peak  of  strain  is  proportional  to  ((  ^)^  where 
P  is  the  negative  of  the  slope  of  the  log  (  vs.  log  N  curve  obtained 
from  fatigue  tests  made  with  constant  amplitude  peaks. 
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Two  relationships  are  now  assumed  between  the  strain  and 
the  response  displacement  z.  First,  a  linear  relationship,  c^z, 
second,  a  nonlinear  relationship,  =  c^z{  1  +  z/2i\/7)  where  Cj  and 
c^  are  constants.  Of  course,  other  relationships  also  exist,  each 
depending  on  the  particular  structure  in  question. 

The  strain  for  instance,  is  the  total  strain  in  the  surface 
fibers  at  the  center  of  a  rectangular  pinned-pinned  beam,  vibrating 
at  its  fundamental  mode  and  is  due  to  a  bending  component 
proportional  to  z  and  a  membrane  component  proportional  to  z^. 

For  the  first  relationship  the  damage  rate,  or  fractional  damage 
per  cycle  is  proportional  to,  see  Ref.  [  32] 


( z  )  P  p(  z  ) 
'  n'  n' 


dz 


n 


(9.61) 


Since  c  is  proportional  to  z,  z^  can  be  interpreted  as  the  strain 
normalized  to  <r^,  the  linear  rms  response. 

The  estimate  of  the  damage  rate  for  a  linear  system  is  given  by 
Eq.  (9.  62)  for  comparison 


(9.  62) 


For  the  second  relationship,  the  normalized  strain  is  given  by 


c 


stn 


(9.  63) 
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Here  the  damage  rate  is  proportional  to 


(9.  64) 


The  integra/ida  for  Eqs.  (9.61),  (9.62),  and  (9.64)  can  be  called  "Damage 


Densities"  and  are  plotted  for  p  =  8  and  /^  =  8  in  Figure  9.  16,  Ref. 


32i  . 

j 


Figure  9.16.  Damage  Density  vs.  Normalized  Displacement  Response 

Figure  9.  16  indicates  that  for  large  values  of  z^  the  density  of  peaks 

is  considerably  less  for  the  nonlinear  system  than  for  the  linear  case 
which  agrees  with  the  previous  discussion  in  Section  9.  2.  3.  Similarly 
for  both  cases  of  the  strain  relationships  the  probability  of  damage  for 
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large  values  of  is  less  for  the  nonlinear  system  than  for  the 
linear  system  for  given  values  z^. 

However,  in  addition,  one  should  also  consider 
the  probability  of  exceeding  some  arbitrary  level  of  stress.  In  the 
previous  discussion  it  was  shown  that  the  probability  of  high  ampli¬ 
tudes  was  reduced  for  the  nonlinear  system.  However,  one  can  almost 
predict  intuitively  that  at  some  given  large  displacement,  the  stress  in 
the  nonlinear  system  will  be  higher  than  in  the  linear  system.  Lyon, 

Ref.  jzzjmade  an  approximate  analysis  for  determining  the  probability 
density  of  stress  maxima  and  minima  for  a  simply  supported  bar 
excited  in  the  first  mode  by  random  noise  and  assuming  the  hardening 
spring  law.  The  qualitative  results  are  shown  in  Figures  9.  17  and  9.  18. 

Figure  9.  17  shows  clearly  in  the  expanded  scale  that  the  probability 
of  large  stresses  occurring  is  much  higher  for  the  nonlinear  system 
than  for  the  linear  system.  A  numerical  example  worked  out  by  Lyon 
shows  that  the  fatigue  life  could  be  cut  by  as  much  as  a  factor  of  2. 

Recent  experiments  by  DA.  Smith  and  R.  F.  Lambert,  Ref.  [^^]> 
have  resulted  in  qualitative  agreement  with  this  prediction. 

Experiments  conducted  with  cantilever  beams.  Ref.  [l^j,  also 
resulted  in  an  actual  fatigue  life  which  was  shorter  by  as  much  as  a 
factor  of  2  when  compared  to  that  predicted  by  linear  theory  when 
subjected  to  random  vibration.  However,  an  explanation  for  this 
result  was  not  given  and  it  may  or  may  not  have  been  due  to  non- 
linearities. 
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PROBABILITY  OF  DENSITY  OF  STRESS  MAXIMA 


Figure  9.17.  Density  of  Stress  Maxima 
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EXPANDED  scale 


PROBABILITY  DENSITY  OF  STRESS  MINIMA 
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NORMALIZED  STRESS  MINIMA 


Figure  9.18.  Density  of  Stress  Minima 


ASD  TDR  62-973 


9-35 


9.  4  OTHER  TYPES  OF  NON  LINEARITIES 
9.4.1.  Set-Up  Spring 

Recently  Crandall,  Ref.  [lo|.  made  an  analysis  determinijjig 
the  response  of  a  nonlinear  system  with  a  set-up  spring.  The  load 
deflection  characteristics  of  this  system  is  shown  in  Figure  9.  19. 


spring  force 


Figure  9.  19.  Nonlinear  Load- Deflection  Curve  of  Set-Up  Sforing 
The  equation  describing  this  characteristic  is 


F(z)  =  k(z  +  '\i  sgn  z)  (9.  (!,5) 

where  4*  =  F  /k. 

o 
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Letting  k  =  write 

—  F(z)  =  w  +  4^  sgn  z)  (9.  66) 

m 

Substituting  Eq.  (9.66)  into  Eq.  (9.  26)  one  obtains 

z  +  2q  z  +  tL)^^(z  +  4*  sgn  z)  =  A(t)  (9.  67) 


It  should  be  noted  from  Fig.  9-19  that  when  the  mass  m  passes 
through  z  =  0  a  jump  occurs  in  the  relative  acceleration  of  magnitude 
2F^/m  but  that  its  relative  velocity  is  continuous.  If  initially  z 
and  z  arc  zero,  they  will  remain  zero  until  the  magnitude  of  A(t) 
exceeds  the  value  F^/m.  It  will  be  assumed  that  A(t)  is  large 
enough  so  that  the  possibility  of  z  and  z  being  zero  occurs  very 
rarely.  The  spectral  density  of  A(t)  is  defined  in  units  of  accelera¬ 
tion  squared  per  radian/sec  over  both  positive  and  negative  frequencies 
with  2=0 


Solving  Eq  (9.67)  exactly  by  the  application  of  the  Fokker-Planck 
equation  (as  discussed  in  Section  9-  2.  3)  results  in  the  following 
probability  densities  for  z  and  z,  Ref.  [  10 


p(z)  =  - -  exp 

\Zit  erfc 

and 


.|z  +  2  4^  z  sgn  zj 


2«r' 


(9.  68) 


exp 


4'' 


2(r' 


r  J 


p(k)  =  - 


''  nr 


exp 


.  2 

z 


2u  ^  ff' 

n  r 


(9.  69) 
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where  =  Zkv ^  ^see  Eq.(9.33)j  is  the  mean  square  response  if 
the  system  were  linear. 

The  "average  resonant  frequency"  is 

w  exp 

Irt  er£c(^M^'\fz) 

The  mean  square  displacement  from  £q.  (9.68)  becomes 

1/2  exp  [-4i^/2<r^^]  ^2 

erfc  (4^/a'  yT) 

^  r 

(9.  71) 

An  approximate  solution  to  Eq.(9.67)  can  be  obtained  by  the  application 
of  the  "equivalent  linearization"  technique  previously  discussed  in 
Section  9-  !■  1.3. 

Similar  to  Eq.(9.43)one  can  write 


(9.  70) 


z  +  2az  +  Az  =  A(t)  +  R 


(9.  72) 


where  the  remainder  term  R  now  is 

e 


Rg=  (9.  73) 


Solving  Eq.(9.72)  as  discussed  in  Section  9.  2.  3.(b)  by  minimizing 

2. 


E(Rg,),  one  obtains;,  Ref.  ^lo]. 


and 


■  t 

Po  -  r  ‘  ^  H  4 

2Tr  I  \lT  /  (T ' 

r 


-1 


(9.  74) 


(9.  75) 
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Figure  9.  20  shows  the  probability  density  p(z)  obtained  from  the  exact 
solution  for  various  values  of  the  nonlinearity  parameter  ^/(r^  ;  vT 
Figure  9.  21  plots  the  ratio  of  nonlinear  to  linear  mean- square  response 
vs.  the  nonlinearity  parameter  and  compares  the  approximate  and  exact 
solutions.  Figure  9.  22  plots  the  ratio  of  nonlinear  "equivalent  resonant 
frequency"  to  linear  natural  frequency  f^  vs.  the  nonlinerrity  parameter 
for  both  the  exact  and  approximate  solutions. 

For  fatigue  studies  the  probability  density  of  peaks  is  of 

interest.  Using  the  result  of  Eq.  (9.68),  Crandall,  Ref.  j^^ioj  shows  this 

I  z  +  4^ 

1  na 


to  be 


m 


exp 


-  (z  +  241  z  ) 
m  m' 


(9.76) 


2o-'“ 

r  r 

The  probability  density  of  the  envelope  connecting  the  peaks  is  given  by 


p  (2  )  = 

'  m' 


■<  +  2+  z^) 

exp  [- 4^V2«r'y^l  2 

■  -  *9  2," 

(r' 

r 

O-' 

L  r  j 

erfc  (4>A'  ^ 

4^ 


z  +4* 

m 

(9.77) 


Eqxiations  (9-  76)  and  (9-  77)  are  plotted  in  Figures  9.  23  and  9.  24 
respectively  for  various  values  of  the  nonlinearity  parameter  4* 

It  should  be  noted  that  the  distribution  of  Eq.  (9.  76)  relates  to  the 
relative  frequency  of  peaks  of  z^  in  the  population  of  all  peaks  whereas 
Eq.  (9.  77)  relates  to  a  smooth  continuous  envelope  ^^^^(t)  which  joins 
succeeding  peaks. 
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Figure  9.24.  Probability  Density  for  Envelope  of  Peake 
z^Jt)  for  Equation  (9.  77) 
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9.  4.  2 


Dead- Zone  Spring 


In  a  report  written  by  R.  E.  Oliver  and  T,  Y.  Wu,  Ref.  ^  29j  , 
Part  II,  under  contract  No.  AF  29(600)- 1 338,  sponsored  by  the  Air  Force 
Missile  Development  Center,  Holloman  Air  Force  Base,  New  Mexico, 
the  problem  of  random  excitation  of  a  dead-zone  spring  is  solved.  The 
general  load  deflection  curve  for  this  spring  is  shown  in  Figure  9.  25. 

Force 


Figure  9.  25.  Load -Deflection  Curve  of  Dead- Zone  Spring 

The  analysis  is  quite  extensive  and  it  is  therefore  beyond  the  scope  of 
this  report  to  go  into  the  detailed  solution  of  this  problem,  and  the 
reader  is  referred  to  Ref.  f  29]. 
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9.4.3 


Nonlinear  Damping 


Two  types  of  nonlinear  damping  (combined  with  linear 
stiffness)  are  most  often  assumed  for  various  physical  applications. 

The  first  is  combined  linear  and  displacement-cubed  damping  some¬ 
times  referred  to  as  hysteresis  or  material  damping.  The  equation 
of  motion  would  then  be  from  Eq.  (9.  26) 

••  •  3  2 

z  +  2az  ±  Cj  z  +  z  =  A(t)  (9.  78) 

3 

where  c^  is  a  constant  of  proportionality  and  c^  z  is  positive  when 
•  3 

z  IS  positive  and  z  is  negative  when  z  is  negative. 

The  second  considers  combined  linear  and  velocity- squared 
damping  often  referred  to  as  air  damping. 

The  equation  of  motion  is 

z  +  2az  +  c^  1*1  *  +  *  =  >^(t)  (9.  79) 

where  c^  is  also  a  constant. 

As  far  as  is  known,  exact  solutions  to  Eqs.  (9.  78)  and  (9.  79), 
when  A{t)  is  a  random  process,  do  not  exist.  McIntosh,  Ref.  |^26j, 
however,  made  an  analog  computer  study  resulting  in  approximate 
solutions  for  both  equations  for  the  root-mean- square  acceleration 
response.  Caughey,  Ref.  obtained  an  approximate  sdution  for  the 
special  case  of  Eq(9.  78)  where  the  hysteresis  loop  is  bilinear  through 
the  application  of  "equivalent  linearization."  The  reader  is  referred 
to  these  two  references  for  a  detailed  discussion  since  it  is  beyond 
the  scope  of  this  summary  to  do  so  here. 
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9.  4.4 


Instrumentation  Nonlinearities 


In  addition  to  the  considerations  of  the  response  cf  non¬ 
linear  mechanical  systems  to  random  excitation,  is  the  response  of 
instrumentation  used  for  measuring  and  analyzing  random  phenomena. 
The  follov/ing  discussion  is  taken  from  Reference 

Consider  first  the  case  of  nonlinear  amplitude  transfer  charac¬ 
teristics  (nonlinear  gain)  which  might  be  associated  with  transducers 
and  data  processing  instrumentation.  Included  in  this  category  is  the 
problem  of  limited  dynamic  range.  When  a  raindom  signal  is  passed 
through  an  amplitude  transfer  characteristic  which  displays  ampli¬ 
tude  linearity,  the  probability  density  function  of  the  signal  will  not  be 
changed.  If,  however,  an  amplitude  transfer  characteristic  is  not 
linear,  the  probability  density  function  of  the  signal  will  be  altered 
by  the  transfer  characteristic.  If  the  probability  density  function  of 
the  signal  is  altered,  the  mean  value  and  the  mean  square  value 
(and  other  statistics)  of  the  signal  will  probably  be  changed  also. 

The  effect  of  nonlinear  amplitude  transfer  characteristics  on  random 
signals  is  briefly  discussed  with  illustrations  in  Section  9,  Ref.  |^2j. 

A  related  general  treatment  of  the  effects  of  nonlinear  transfer 
characteristics  on  the  statistics  of  random  signals  is  available 
from  Reference^izj,  Chapters  IZ  and  13. 

The  term  "limited  dynamic  range"  might  be  interpreted  in  two 
ways  The  first  interpretation  is  a  transfer  characteristic  (gain 
function)  with  a  gain  of  one  for  amplitudes  with  absolute  values  below 
some  specified  level,  and  a  gain  of  zero  for  amplitudes  greater  than 
that  specified  level.  In  other  words,  an  instantaneous  input 
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amplitude  with  a  value  outside  the  dynamic  range  limits  would  result 
in  an  instantaneous  output  amplitude  of  zero.  Such  an  interpretation 
of  limited  dynamic  range  has  little  physical  significance.  In  reality, 
limited  dynamic  range  usually  implies  a  transfer  characteristic 
which  limits  amplitudes  with  absolute  values  above  some  specified 
level  to  that  specified  level.  This  second  interpretation  is  more 
representative  of  such  phenomena  as  clipping,  magnetic  saturation, 
and  similar  physical  limitations  on  amplitude  linearity. 

The  specific  effect  of  both  interpretations  of  limited  dynamic 
range  on  a  random  signal  with  a  uniform  input  probability  density 
function  will  now  be  developed. 

Consider  the  general  case  of  a  stationary  random  signal  with 
an  amplitude  probability  density  function  Pj^(y)  when  passed  through 
an  amplitude  transfer  characteristic  H(y)  with  limited  dynamic  range. 


mam 

1 

1 

D 

1 

1 

IBBH 

Hypothetically,  two  interpretations  of  limited  dynamic  range  are 
possible.  The  amplitude  transfer  characteristic  H(y)  may  be 
such  that  amplitudes,  of  y  less  than  y^  or..greater  than  y^  are: 

(a)  excluded  (equal  to  zero) 

(b)  limited  to  values  of  yj  or  y^ 
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Case  (a)  would  occur  in  a  device  which  "open-circuits"  when  input 
signals  are  above  a  level  or  below  a  level  y^. 

Case  (b)  would  occur  in  a  device  which  clips  or  limits  when  input 
signals  are  above  a  level  y^  or  below  a  level  y^. 

The  transfer  characteristic  H(y)  associated  with  each  of  the 

two  interpretations  for  limited  dynamic  range  may  be  thought  of 

graphically  as  shown  above.  The  vertical  dashed  lines  labeled 

(a)  complete  the  transfer  characteristic  for  case  (a)  and  the  dashed 

lines  labeled  (b)  complete  the  transfer  characteristic  for  case  (b). 

The  two  transfer  characteristics  may  also  be  presented  in  the  form 

of  input-output  plots  as  shown  below. 


If  the  input  has  a  uniform  probability  density  function,  Reference  j^Zj  has 
shown  that  the  output  probability  density  will  have  the  characteristics 
shown  in  Figure  9.  Z6  for  cases  (a)  and  (b)  discussed  above. 

Since  for  case  (a)  all  amplitudes  larger  than  y  are  zero,  one 
would  intuitively  expect  a  clustering  at  z  =  0.  For  case  (b)  all  ampli¬ 
tudes  larger  than  y  are  equal  to  z  =  |b|  and  one  would  expect  cluster¬ 
ing  at  z  =  jbj  .  The  theoretical  results  substantiate  these  expectations 
resulting  in  delta  functions  at  z  =  0  for  case  (a)  and  at  z  =  |b|  for  case  (b). 
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INPUT: 


A  uniform  probability  density  function  with  a 
mean  value  of  zero. 


AMPLITUDE 

TRANSFER  A  gain  of  one  with  limited  dynamic  range  of  two 

CHARACTERISTIC:  types  as  shown. 


-a  0  a  -a  0 

Amplitude  Amplitude 


INPUT.  G.(y) 


H(y)  H(y) 


H(y)  such  that  amplitudes  of  H(y)  such  that  amplitudes  cf|y{>b 

I  y(>b  are  excluded  (equal  are  limited  to  a  value  of  b. 

to  zero) 


AMPLITUDE  TRANSFER 
CHARACTERISTIC,  G(y) 


Amplitude  Amplitude 


OUTPUT,  G^(z) 


Figure  9.  26.  Output  Probability  Density  Function  as  Function  of 
Two  Different  Nonlinear  Transfer  Characteristics 
(Uniform  Input  Probability  Density  Function) 
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S*  Icr 


Pastel,  Ref.  [30  J  ,  has  given  the  output  probability  density 
when  the  input  is  Gaussian  for  the  case  No.  2  discussed  above.  This 
is  shown  in  Figure  9.  27(A).  As  in  Figure  9.  26  (case  2),  delta  functions 
appear  at  the  tails  of  the  output  distribution.  In  addition,  various 
output  distributions  are  shown  for  several  other  types  of  transfer 
functions  for  a  Gaussian  input  probability  density  function. 

Of  the  above  types  of  nonlinearities,  limited  dynamic  range  as 
represented  by  Figure  9. 27(A) constitutes  the  most  common  problem 
in  vibration  measurement  work.  Even  with  the  highest  quality 
instrumentation,  a  test  engineer  may  unduly  limit  the  dynamic 
range  of  random  signal  measurements  by  improper  use  c£  the 
measurement  equipment.  A  common  example  is  the  improper  use 
of  instruments  which  were  designed  primarily  for  harmonic  signal 
work 

Many  instruments  used  in  association  with  vibration  measure¬ 
ment  and  analysis  are  equipped  with  input  attenuators  and  signal 
level  meters  which  permit  input  signals  levels  to  be  appropriately 
adjusted  for  the  dynamic  range  limits  of  the  particular  instrument. 

To  keep  the  signal  to  noise  ratio  as  high  as  possible,  it  is  not  un¬ 
common  for  the  test  engineer  to  adjust  the  input  attenuators  so  that 
signal  levels  are  near  the  upper  limits  of  the  instrument's  dynamic 
range.  If  the  input  signal  level  meter  is  a  conventional  average 
sensing  voltmeter  calibrated  in  rms  for  sine  waves,  the  maximum 
input  level  to  the  instrument  as  defined  on  the  meter  would  probably 
correspond  to  that  voltage  level  where  the  instrument  begins  to  clip 
sine  waves.  In  other  words,  the  instrument  would  clip  voltage  levels 
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Figure  9.27.  Output  Probability  Density  Functions  for 
Various  Nonlinear  Transfer  Functions 
for  a  Gaussian  Input 
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of  about  1.  4  times  the  maximum  rms  voltage  input  as  defined  on 
the  meter. 

For  the  case  of  input  signals  which  are  random  and  have  a 
Gaussia..  amplitude  probability  density,  the  rms  value  of  a  Gaussian 
signal  (lo^)  would  be  (2-\/ir)  or  approximately  1.  3  times  the  reading 
of  an  average  sensing  voltmeter  calibrated  in  rms  for  sine  waves, 

Ref.  .  Then  if  a  Gaussian  input  signal  was  adjusted  to  the  maxi¬ 
mum  indicated  input  level  for  such  an  instrument,  clipping  would 
occur  for  signal  amplitudes  above  only  1.  25  cr. 

Sometimes  the  problem  of  limited  dynamic  rauige  is  unavoid¬ 
able  as  in  the  case  of  the  engineer  who  has  no  control  over  sensitivity 
or  gain  settings  of  the  instruments  during  the  actual  measurements. 
For  missile  vibration  measurements  in  particular,  unless  the  test 
engineer  has  some  prior  knowledge  of  the  environment,  he  often  must 
estimate  what  the  vibration  levels  will  be  and  pre-set  the  gain  of  the 
measurement  instruments  accordingly.  If  the  estimate  of  the 
environment  is  poor,  the  data  may  be  obscured  by  background  noise 
or  distorted  by  clipping.  The  problem  is  further  aggravated  when 
the  desired  vibration  response  measurements  are  to  cover  several 
different  flight  phases  characterized  by  different  sources  of  excita¬ 
tion  producing  widely  varying  response  levels. 
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3  CONCLUSIONS  AND  RECOMMENDATIONS 

The  foregoing  summary  has  shown  that  much  effort  on 
analyzing  nonlinear  systems  has  been  expended  during  the  last  few 
years.  It  also  indicates  that  some  areas  appear  to  be  almost  com¬ 
pletely  unexplored.  It  is  realized  that  a  number  of  investigations  exist 
which  contain  material  not  known  or  discussed  herein.  Also,  many 
of  the  references  that  have  been  noted  contain  more  material  than 
presented  here.  However,  some  general  conclusions  will  be  stated 
as  to  where  considerable  work  remains  to  be  done. 

The  area  of  structural  damping  particularly  appears  to  need 
attention.  Several  companies  and  universities  are  presently  studying 
this  problem.  Exact  and  approximate  analytical  solutions  are  needed 
for  systems  with  nonlinear  damping,  different  types  of  stiffness  non- 
linearities,  and  combined  nonlinear  damping  and  nonlinear  stiffness, 
when  these  systems  are  subjected  to  random  forcing  functions. 

Further  experimental  study  of  idealized  types  of  structures  is  also 
required  to  determine  which  analytical  models  best  fit  particular 
types  of  nonlinear  structures  when  the  input  is  of  a  random  nature. 

The  following  specific  recommendations  are  therefore  made 
for  future  work. 

1.  Further  experimental  study  to  find  proper  analytical 
models  for  systems  with  structural  damping. 

2  Theoretical  study  of  equations  of  motion  with  random 

forcing  functions  for  systems  with  combined  viscous  and 
displacement-cubed  damping,  and  for  combined  viscous 
and  velocity-squared  damping. 

3.  Theoretical  study  of  equations  of  motion  with  random 
forcing  functions  for  systems  having  different  types  of 
nonlinear  stiffness  characteristics. 

4.  Theoretical  study  of  equations  of  motion  with  random 
forcing  functions  for  systems  with  combined  nonlinear 
stiffness  and  nonlinear  damping. 

5.  Experimental  studies  to  determine  which  analytical  model 
best  fits  various  types  of  nonlinear  structures  subjected 
to  random  inputs 
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9.6 
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10.  CONCLUSIONS  AND  RECOMMENDATIONS 
FROM  THEORETICAL  PROGRAM 


The  objectives  of  the  contract  and  a  brief  summary  of  main 
results  are  stated  in  Section  1.  Part  I  of  this  report  deals  with  the 
theoretical  studies  on  random  signal  estimation.  To  terminate  Part  I 
of  this  report,  a  section-by-section  review  will  be  given  here  of  the 
theoretical  material  in  Sections  2  through  9,  followed  by  recommenda¬ 
tions  for  further  theoretical  and  experimental  work.  A  review  of  the 
experimental  work  carried  out  for  this  contract  appears  in  Section  18 
of  Part  II,  together  with  its  own  conclusions  and  recommendations. 

10.  1  REVIEW  OF  THEORETICAL  PROGRAM 

Section  2.  Methods  for  Estimating  Mean  Values  of  Nonstationary  Data 

Results  are  derived  in  this  section  for  the  accuracy  to  be  associated 
with  mean  value  (average  response)  computations  on  a  wide  class  of  non¬ 
stationary  data  as  a  function  of  underlying  signal  and  noise  vibrations, 
and  the  sample  size  used  by  the  mean  value  computer.  Input  and  output 
signal-to-noise  ratios  are  defined  in  terms  of  these  quantities.  Confidence 
bands  are  determined  for  both  arbitrary  probability  distributions  and  for 
Gaussian  probability  distributions,  which  indicate  how  closely  a  measured 
sample  mean  value  approximates  the  true  mean  value  at  any  time.  A 
special  result  shows  the  increase  in  sample  sizes  required  for  arbitrary 
distributions  as  opposed  to  Gaussian  distributions  in  order  to  achieve  a 
desired  confidence  band.  Three  cases  are  developed  according  to 
whether  or  not  the  sample  records  are  (1)  independent,  (2)  dependent, 

(3)  correlated.  The  last  case  includes  the  other  two  as  special  cases. 
Adaptive  changes  in  records  as  a  result  of  repeated  excitations  or 
stimuli,  such  as  produced  by  structural  fatigue  effects  or  physiological 
learning  patterns,  may  be  analyzed  by  the  mathematical  model  discussed 
herein.  A  quantitative  technique  is  described  using  an  exponential 
correlation  function  which  can  characterize  the  extent  of  the  correlation 
between  samples  of  nonstationary  data,  and  thus  compare  different 
physical  situations. 

Section  3.  Estimation  of  Nonstationary  Mean  Square  Values 

This  section  considers  the  problem  of  measuring  mean  square 
values  of  nonstationary  data.  Mean  square  values  represent  an  important 
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physical  characteristic  for  describing  the  "power"  contained  in  the  data. 
Also,  mean  square  values  are  useful  to  analyze  data  where  the  mean 
values  are  zero,  a  fairly  common  occurrence  with  random  phenomena. 
Results  are  developed  along  lines  similar  to  the  previous  section. 

Three  cases  are  discussed  according  to  whether  or  not  the  sample 
records  are  (1)  independent,  (2)  dependent,  (3)  correlated.  The  variance 
associated  with  measurements  of  mean  square  values  of  nonstationary 
data  is  determined  as  a  function  of  underlying  input  signal  and  noise 
variations,  and  the  number  of  records  (sample  size)  available  for  the 
calculations.  From  these  formula,  for  given  input  conditions,  it  is 
possible  to  state  in  statistical  terms  how  well  one  is  able  to  measure 
the  true  mean  square  value  at  any  time  as  a  function  of  the  sample  size. 
The  case  of  correlated  samples  provides  a  method  for  analyzing  fatigue 
effects  or  other  adaptive  physical  changes. 

Section  4.  Spectral  Decomposition  of  Nonstationary  Processes 

After  reviewing  the  known  Fourier  transform  correspondence 
between  power  spectral  density  functions  and  autocorrelation  functions 
for  stationary  random  processes,  this  section  extends  these  concepts 
to  nonstationary  random  processes.  It  is  shown  by  proper  definitions 
and  interpretation  that  nonstationary  power  spectral  density  functions 
and  nonstationary  autocorrelation  functions  are  double  Fourier  trans¬ 
forms  of  one  another,  which  reduce  to  the  known  formulas  in  the 
stationary  case.  A  similar  mathematical  correspondence  is  shown  to 
exist  for  nonstationary  cross-power  spectral  density  functions  and  non¬ 
stationary  cross-correlation  functions.  Special  situations  are  considered 
of  separable  nonstationary  correlation  functions  and  of  locally  stationary 
correlation  functions  where  the  desired  formulas  assume  simpler  forms. 
Locally  stationary  processes  may  be  used  to  represent  important 
physical  problems,  such  as  turbulence,  where  the  average  instantaneous 
power  may  vary  slowly  with  respect  to  the  correlation  time.  Estimation 
problems  in  measurement  of  nonstationary  power  spectral  density  func¬ 
tions  are  discussed  for  cases  of  slowly  varying  nonstationary  random 
processes. 


ASD  TDR  62-973 


10-2 


Section  5.  Input-Output  Relations  for  Nonstationary  Processes 

This  section  derives  mathematical  formulas  to  analyze  input- 
output  relations  when  nonstationary  random  processes  pass  through  time- 
varying  or  constant  parameter  linear  systems.  Stability  and  physical 
realizability  conditions  are  noted  for  these  systems,  as  well  as  certain 
bandwidth  properties.  General  relationships  are  found  between  input  and 
output  nonstationary  autocorrelation  and/or  cross-correlation  functions, 
and  between  input  and  output  nonstationary  power  spectral  density  and/or 
cross-power  spectral  density  functions.  The  results  presented  here 
extend  simpler  well-known  results  which  apply  to  stationary  random 
processes.  In  order  to  place  later  material  devoted  to  nonlinear  systems 
on  a  proper  foundation  (Section  9),  a  discussion  is  given  of  (1)  general 
linear  transformations  of  random  functions,  (2)  integral  transformations, 
and  (3)  derivative  transformations.  In  particular,  input-output  moment 
transformations  are  treated.  For  certain  problems,  the  existence  of 
the  derivative  of  a  nonstationary  (stationary)  random  process  is  shown 
to  depend  upon  the  existence  of  the  first  derivative  of  its  nonstationary 
(stationary)  autocorrelation  function. 

Section  6.  Example:  Nonstationary  Process  .... 

With  the  aid  of  formulas  derived  in  the  preceding  two  sections,  an 
example  is  treated  of  a  nonstationary  process  resulting  from  amplitude 
modulation  and  filtering  of  a  stationary  random  process.  Besides  help¬ 
ing  to  explain  certain  physical  phenomena  which  may  be  generated  in 
this  way,  this  example  provides  some  analytical  results  which  may  be 
applied  towards  evaluating  spectrum  simulators.  Calculations  are 
carried  out  of  the  various  stationary  and  nonstationary  auto  and  cross¬ 
correlation  functions,  and  power  and  cross-power  spectral  density 
functions,  which  occur  within  the  time-varying  linear  system  of  this 
example. 

Section  7.  Sampling  Considerations  for  Flight  Vehicle  Vibration  Problems 

This  section  begins  by  reviewing  certain  material  in  the  previous 
contract  devoted  to  choosing  an  appropriate  random  saunpling  scheme  for 
decreasing  the  aunount  of  data  to  be  collected  for  later  analysis. 
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Considerations  involved  in  periodic  sampling  of  random  data  are  then 
discussed.  For  either  random  sampling  or  periodic  sampling,  it  is 
noted  when  the  data  must  be  both  random  and  stationary  if  the  prediction 
formulas  are  to  be  useful.  The  uncertainty  in  measured  sample  values 
xs  another  factor  that  should  be  considered.  Thus,  one  sees  the  impor¬ 
tance  of  certain  experimental  results  in  Part  II  which  have  accurately 
determined  expected  measurement  uncertainties,  and  which  have 
developed  practical  statistical  tests  for  randomness  and  stationarity. 
Some  of  these  experimental  results  are  summarized  here.  Examples 
are  given  showing  how  to  choose  appropriate  sampling  procedures  for 
different  applications.  In  order  to  prepare  the  reader  for  material  in 
the  next  Section  8,  this  section  closes  by  reviewing  certain  statistical 
procedures  in  the  previous  contract,  as  well  as  some  other  statistical 
techniques,  for  analyzing  a  set  of  sample  values  from  a  single  experi¬ 
ment  (e.  g.  ,  data  from  a  single  point).  Two  cases  are  developed 
according  to  whether  or  not  one  includes  in  the  analysis  the  measure¬ 
ment  uncertainties  in  the  sample  values. 

Section  8.  Analysis  of  Variance  Procedures  for  Evaluating 
Vibration  Data  from  Many  Points 

This  section  presents  a  direct  extension  of  the  basic  analysis  of 
variance  techniques  discussed  in  the  previous  contract  under  the  heading 
of  "Repeated  Experiments.  "  These  procedures  supply  a  classical 
statistical  method  of  attack  for  investigating  vibration  data  collected  at 
several  points  of  a  structure  simultaneously,  during  one  or  many  flights. 
Three  basic  cases  of  analysis  of  variance  are  described.  They  are: 

(a)  the  fixed  effects  model,  (b)  the  random  effects  model,  and  (c)  the 
mixed  effects  model.  In  the  one-factor  or  one-way  variance  analysis, 
only  the  first  two  cases  have  meaning  since  only  one  variable  is  con¬ 
sidered.  However,  for  the  two-factor  (two-way)  variance  analysis, 
two  variables  are  considered  which  gives  rise  to  the  third  case.  The 
two-way  variance  analysis  is  further  broken  down  into  two  special 
cases  corresponding  to  cases  where  only  one  observation  is  available 
per  combination,  or  where  several  observations  are  available  per 
combination.  Several  comprehensive  computational  examples  are 
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given  illustrating  all  the  fundamental  variations.  Emphasis  is  placed 
upon  the  proper  decision  procedures  and  proper  interpretation  of 
results.  It  should  be  noted  that,  for  even  relatively  small  amounts  of 
data,  the  computations  involved  can  become  quite  extensive.  A  digital 
computer  is  thus  seen  to  be  an  invaluable  tool  for  carrying  out  these 
computations. 

Section  9.  Response  of  Nonlinear  Systems  to  Random  Excitation 

The  material  presented  in  this  section  summarizes  and  reviews 
much  of  the  analytical  and  experimental  results  available  to  date  on  this 
subject.  The  response  of  the  "Hardening  Spring"  to  random  excitation 
is  covered  in  considerable  detail.  This  is  followed  by  a  discussion  of 
other  types  of  nonlinearities  such  as  the  response  of  nonlinear  structures, 
fatigue  of  nonlinear  structures,  the  set-up  spring,  the  least-give  spring, 
nonlinear  damping,  and  instrumentation  nonlinearities. 

10.  2  RECOMMENDATIONS  FOR  FURTHER  THEORETICAL 
AND  EXPERIMENTAL  WORK  FROM  PART  I 

For  nonstationary  data  analysis  and  applications  t:o  vibration 
problems,  as  well  as  to  other  physical  problems,  there  are  three  main 
recommendations  for  further  work: 

1.  Development  of  special  statistical  procedures  and  design  of 

appropriate  experimental  programs  for  analyzing  nonstationary 
data  according  to  formulas  derived  in  Sections  2  through  5  of  this 
report.  This  should  be  followed  by  an  experimental  program  for 
experimental  verification  of  the  validity  and  practical  nature  of 
these  techniques,  which  will  yield  final  improved  theoretical 
methods  for  measuring  desired  properties  of  nonstationary  data. 

2.  Further  investigations  of  different  examples  of  physical  systems 
leading  to  nonstaticnary  processes  as  per  example  in  Section  6 
of  report.  Unifying  principles  should  be  sought  to  describe  non¬ 
stationary  response  behavior  and  transfer  characteristics  for 
special  categories  of  systems,  both  linear  and  nonlinear.  This 
should  lead  to  better  predictions  of  expected  nonstationary 
environments,  with  more  accurate  design  and  simulation  require¬ 
ments  for  systems  which  must  operate  in  such  environments. 
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3.  Studies  on  accuracy  in  estimating  nonstationary  cross¬ 
correlation  functions  for  different  mathematical  models,  and 
research  on  suitable  physical  applications  of  these  methods. 
These  applications  should  yield  improved  detection  methods  for 
separating  signals  from  noise,  and  should  yield  improved  tech¬ 
niques  for  predicting  desired  properties  of  the  data  being 
analyzed. 

To  advance  other  work  in  Sections  7,  8,  and  9  of  this  report, 
concerned  with  estimating  various  flight  vehicle  vibration  properties, 
and  nonlinear  systems,  the  following  recommendations  are  made; 

1.  Design  and  carry  out  an  appropriate  experimental  program  to 
verify  the  sampling  methods  of  Section  7,  and  analysis  of 
variance  techniques  of  Section  8,  as  applied  to  vibration  data. 
This  would  mainly  be  for  establishing  the  suitability  of  random 
or  periodic  sampling,  and  the  appropriateness  of  underlying 
mathematical  variance  models. 

2.  Design  and  develop  necessary  digital  computer  programs  for  the 
data  reduction  associated  with  the  sampling  methods  and  with 
the  analysis  of  variance  procedures.  The  input  and  output 
features  of  the  program  should  take  into  account  special  charac¬ 
teristics  of  vibration  data. 

3.  Perform  further  theoretical  work  aimed  at  simplification  of  the 
sampling  methods  and  the  analysis  of  variance  procedures.  This 
simplification  should  be  guided  and  influenced  by  the  experi¬ 
mental  investigations. 

4.  Develop  and  experimentally  verify  appropriate  mathematical 
models, as  suggested  in  Section  9,  for  analyzing  continuous 
structures  with  nonlinear  stiffness  and/or  nonlinear  damping 
characteristics. 
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PART  II 


EXPERIMENTAL  STUDIES  OF  RANDOM  SIGNAL  MEASUREMENTS 


Special 

Notice 


The  experiments  discussed  herein  involve 
many  different  types  of  commercial  instruments. 
In  order  to  accurately  and  completely  describe 
the  details  of  the  experiments  performed,  the 
instruments  employed  for  each  experiment  are 
identified  by  manufacturer  and  model  number. 

It  is  to  be  clearly  understood  that  the  actual  in¬ 
struments  used  for  each  experiment  were  selected 
solely  on  a  basis  of  availability.  These  instru¬ 
ments  should  not  be  regarded  as  either  superior 
or  inferior  to  any  other  commercial  instruments 
which  will  accomplish  the  same  de  sired  functions. 
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11.  I  GENERAL  BACKGROUND 

When  flight  vehicle  vibration  data  is  gathered  and  analyzed,  the 
usual  objective  is  to  obtain  information  concerning  the  vibration  environ¬ 
ment  to  be  expected  during  future  missions  for  that  and  all  similar 
vehicles.  Given  a  sample  vibration  response  amplitude  time  history 
record  obtained  during  the  flight  of  a  given  vehicle,  one  may  readily 
measure  various  descriptive  properties  of  the  recorded  vibration 
response,  such  as  amplitude  probability  density  functions,  correlation 
functions,  power  spectral  density  functions,  etc.  However,  these 
measurements  describe  only  the  vibration  response  in  that  vehicle  for 
that  interval  of  time  in  the  past  when  the  sample  record  was  obtained. 

If  the  measurements  are  to  be  of  value  for  predicting  the  vibration 
environment  during  future  missions  of  that  and  other  similar  vehicles, 
certain  fundamental  characteristics  of  the  vibration  environment  must 
be  considered.  Three  such  characteristics  are  randomness,  stationarity, 
and  normality. 

If  the  vibration  environment  is  random  and  stationary,  the  descrip¬ 
tive  properties  measured  from  recorded  samples  of  the  vibration 
response  will  constitute  estimators  for  the  true  properties  of  the 
response.  The  sampling  errors  for  these  measurements,  that  is  the 
uncertainties  of  the  estimates,  are  vitally  important  to  the  accuracy  of 
conclusions  which  will  be  drawn  from  the  data. 

These  matters  have  been  considered  theoretically  in  the  document 
ASD  TR  61-1Z3,  "The  Application  of  Statistics  to  the  Flight  Vehicle 
Vibration  Problem.  "  Quantitative  procedures  for  testing  sample  vibra¬ 
tion  response  records  for  randomness,  stationarity,  and  normality  are 
suggested  in  Section  6  of  that  document.  The  techniques  for  estimating 
the  descriptive  properties  of  a  vibration  response,  such  as  power  spectra 


Vibration  response  amplitudes  are  usually  obtained  in  the  form  of 
voltage  signals  from  transducers,  and  may  be  a  measure  of  any  physi¬ 
cal  response  parameter  (acceleration,  velocity,  displacement,  stress, 
etc.  )  depending  upon  the  nature  of  the  transducer  employed.  The 
particular  response  parameter  being  measured  is  of  no  direct  importance 
to  the  analysis  procedures  discussed  herein. 
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and  probability  density  functions,  and  the  uncertainties  associated  with 
their  estimation  are  discussed  in  Section  7  of  that  document.  Many  of 
these  theoretical  ideas  are  now  to  be  studied  experimentally. 

11.  2  UNCERTAINTIES  OF  VIBRATION  RESPONSE  MEASUREMENTS 
When  the  descriptive  properties  of  a  vibration  response  at  some 
point  on  the  structure  of  a  flight  vehicle  are  determined  from  a  sample 
record,  an  important  question  arises.  How  accurately  do  the  properties 
determined  from  the  sample  record  represent  the  actual  properties  of 
the  vibration  response  being  sampled?  The  expected  deviation  of  deter¬ 
mined  properties  from  actual  properties  of  the  vibration  response  may 
be  generally  thought  of  as  the  data  analysis  error. 

When  a  vibration  response  is  periodic  in  nature,  a  sample  record 
with  a  length  of  only  one  period  is  theoretically  sufficient  to  define  the 
exact  vibration  amplitude  that  would  exist  at  any  time  assuming  identi¬ 
cal  conditions.  Thus,  the  only  limitations  upon  the  accuracy  of  periodic 
vibration  response  measurements  are  the  errors  associated  with  the 
instruments  and  calibration  procedures  employed,  which  will  be  called 
measurement  errors.  Measurement  errors  consist  of  all  factors  in 
the  translation  of  a  vibration  response  into  final  data  which  produce 
deviations  from  an  exact  or  mathematically  precise  translation,  Included 
are  amplitude  nonlinearities,  imperfect  frequency  response,  sensitivity 
drift,  etc.  ,  in  the  data  acquisition  and  analysis  instruments,  as  well  as 
observation  errors  in  any  visual  readouts.  The  manufacturers  of 
vibration  transducers,  transmission  systems,  recorders,  and  analyzers 
usually  publish  the  accuracy  limits  that  their  instruments  are  designed 
to  meet. 

For  a  random  vibration  response  (assumed  to  be  stationary),  the 
amplitude  at  any  instant  of  time  in  the  past  or  future  supplies  infor¬ 
mation  concerning  the  properties  of  the  vibration.  Even  if  the  measure¬ 
ment  procedure  employed  were  mathematically  precise  (no  measure¬ 
ment  errors),  the  exact  properties  of  the  vibration  response  could  be 
established  only  by  investigating  the  amplitudes  over  all  time.  The 
data  obtained  from  sample  records  of  finite  length  constitute  only 
statistical  estimates  of  the  properties  of  the  vibration.  The  expected 


ASD  TDR  62-973 


11-2 


deviation  of  the  estimated  properties  from  the  actual  properties  of  a 
random  vibration  response  may  be  thought  of  as  an  error,  which  will 
be  called  the  sampling  error  or  uncertainty.  The  accuracy  of  the 
estimation,  as  well  as  the  accuracy  of  the  measurement,  must  always 
be  considered  in  the  analysis  of  a  random  vibration  response  from 
sample  records. 

Measurement  errors  are  determined  by  the  specific  instruments 
and  calibration  procedures  used.  On  the  other  hand,  sampling  errors 
or  estimation  uncertainties  are  a  function  of  the  length  of  sample  records 
selected  for  analysis  and  inherent  properties  of  the  vibration  response 
being  analyzed.  It  is  the  sampling  errors  or  uncertainties  that  are  of 
concern  in  these  experimental  studies. 

The  simplest  property  used  to  describe  a  single  random  vibration 
response  is  the  mean  square  or  root  mean  square  value.  However,  this 
yields  only  a  rudimentary  definition  of  the  vibration  amplitude.  A  more 
detailed  description  is  given  by  two  important  properties,  the  power 
spectral  density  function  and  the  amplitude  probability  density  function. 

A  third  important  property  is  the  autocorrelation  function  which,  for  a 
stationary  vibration  response,  is  the  inverse  Fourier  Transform  of  the 
power  spectrum.  A  fourth  property  of  interest  is  the  expected  number 
of  zero  crossings  per  second. 

The  power  spectrum  of  a  stationary  random  vibration  response 

is  a  measure  of  the  relative  power  per  cps  versus  frequency  and  has 

2  2  2  2 
the  units  volts  /cps;  i.  e.  ,  g  /cps,  inches  /cps,  psi  /cps,  etc. 

Analytically,  the  power  spectrum  of  a  stationary  random  signal  is  the 

Fourier  Transform  of  the  autocorrelation  function  of  the  signal.  Hence, 

the  power  spectrum  can  theoretically  be  obtained  either  directly  by 

filtering  in  the  frequency  domain  or  indirectly  by  filtering  in  the  time 

domain  (autocorrelation)  and  determining  the  Fourier  Transform  of 

the  results.  These  studies  are  concerned  with  the  estimation  of  power 

spectra  by  direct  frequency  filtering.  Autocorrelation  analysis  is 

considered  only  in  qualitative  terms. 

The  probability  density  function  of  a  stationary  random  vibration 
response  defines  the  likelihood  of  given  amplitude  occurrences.  It 
gives  a  complete  description  of  the  vibration  amplitude  as  opposed  to 
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the  mean  square  value  which  yields  only  a  rudimentary  measure  of 
vibration  amplitude.  The  expected  number  of  zero  crossings  per 
second  for  a  stationary  vibration  response  presents  interesting  impli¬ 
cations  concerning  the  random  nature  of  the  vibration. 

Sections  12,  13,  and  14  herein  are  concerned  with  the  uncertain¬ 
ties  of  zero  crossing,  power  spectra,  and  probability  density  estimates 
resulting  from  sample  record  measurements.  Section  12  deals  with 
zero  crossing  estimates.  Section  13  with  power  spectra  estimates, 
and  Section  14  with  probability  density  estimates.  Estimation  un¬ 
certainties  are  discussed  before  the  tests  for  fundamental  character¬ 
istics  because  uncertainty  considerations  form  a  basis  for  these  tests. 

11.3  FUNDAMENTAL  CHARACTERISTICS  OF  VIBRATION 
ENVIRONMENTS 

Given  the  task  of  analyzing  a  flight  vehicle  vibration  environ¬ 
ment,  the  first  question  which  should  be  answered  is  as  follows.  Is  the 
vibration  response  being  measured  random  in  nature  as  opposed  to 
periodic?  Perhaps  both  random  and  periodic  components  are  present. 
The  desired  procedures  for  analyzing  and  describing  the  vibration 
environment  may  be  quite  different  for  each  case.  The  techniques  for 
applying  the  end  data  to  design  problems  are  also  affected.  Periodic 
vibrations  can  be  described  by  explicit  analytic  functions  while  random 
vibrations  must  be  described  by  statistical  functions.  As  a  result,  the 
length  of  sample  records  to  be  gathered  for  analysis  is  more  critical 
for  random  vibrations  due  to  inherent  statistical  uncertainties  or 
sampling  errors  in  the  resulting  measurements. 

If  a  vibration  environment  is  random  in  nature,  the  next  funda¬ 
mental  characteristic  of  interest  is  stationarity.  Is  there  reason  to 
believe  that  the  vibration  response  being  measured  will  exist  in  the 
future  under  conditions  identical  to  those  which  existed  when  a  sample 
record  was  obtained  for  analysis?  Clearly,  the  problem  of  predicting 
future  events  is  directly  dependent  upon  the  stationary  characteristics 
of  the  vibration  environments  being  measured  and  analyzed. 

The  third  fundamental  characteristic  to  be  considered  is 
normality.  For  a  random  vibration,  do  the  instantaneous  vibration 
amplitudes  have  a  Gaussian  probability  density  function?  If  the 
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amplitude  distribution  for  a  random  vibration  environment  is  found  to  be 
sufficiently  Gaussian  to  justify  the  normality  assumption,  the  application 
of  the  resulting  data  to  design  problems  is  greatly  simplified.  Further¬ 
more,  the  existence  of  normality  will  greatly  increase  the  power  of 
conclusions  concerning  the  stationary  characteristics  of  the  vibration 
environment. 

During  the  measurement  and  analysis  of  a  flight  vehicle  vibration 
environment,  the  characteristics  of  randomness,  stationar ity,  and/or 
normality  are  often  assumed  without  quantitative  justification.  In  many 
cases,  strong  qualitative  arguments  can  be  developed  which  tend  to 
justify  any  or  all  of  the  assumptions.  For  example,  if  one  can  substantiate 
that  the  exciting  forces  to  be  expected  during  a  mission  are  basically 
stochastic  processes  (such  as  aerodynamic  boundary  layer  turbulence 
and  jet  exhaust  gas  mixing),  it  appears  appropriate  to  assume  that  the 
vibration  responses  will  be  primarily  random  in  nature.  If  it  is  known 
that  at  least  certain  phases  of  a  mission  will  occur  under  reasonably 
constant  conditions  (airspeed,  altitude,  thrust,  etc.  ),  there  appears  to  be 
no  reason  to  question  that  the  vibration,  responses  will  be  stationary  during 
such  phases.  If  the  vibration  environment  is  random,  the  practical 
implications  of  the  Central  Limit  Theorem  in  statistics  tend  to  support 
an  assumption  that  the  instantaneous  vibration  amplitudes  will  be  distri¬ 
buted  in  a  Gaussian  manner. 

On  the  other  hand,  unknown  or  overlooked  factors  may  destroy  the 
validity  of  these  assumptions.  For  example,  a  flight  vehicle  may  carry 
equipments  which  generate  intense  periodic  vibrations  in  local  areas. 
Unexpected  events  may  occur  during  a  mission  which  produce  extreme 
vibration  levels  for  short  intervals  during  a  period  of  assumed  stationary 
conditions.  Lack  of  normality  in  the  exciting  forces  and/or  nonlinear 
characteristics  of  the  structure  may  result  in  vibration  response  ampli¬ 
tude  distributions  which  deviate  significantly  from  the  ideal  Gaussian  form. 

It  is  important  that  fundamental  assumptions  such  as  randomness, 
stationarity,  and  normality,  be  confirmed  when  possible  by  investigation 
of  the  sample  vibration  response  records  gathered  for  analysis. 
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Sections  15,  16,  and  17  herein  are  concerned  with  the  determina¬ 
tion  of  fundamental  characteristics  of  a  vibration  response  by  tests 
applied  to  sample  record  measurements.  Section  15  deals  with  tests 
for  randomness,  Section  16  with  tests  for  stationarity,  and  Section  17 
with  tests  for  normality. 

11.4  DEFINITIONS  OF  FUNDAMENTAL  CHARACTERISTICS 

It  is  appropriate  here  to  define  the  terms  random,  stationary, 
and  normal  as  they  are  used  in  these  studies.  The  definitions  presented 
are  limited  and  not  necessarily  rigorous.  More  discussions  and 
definitions  of  these  fundamental  characteristics  are  available  in  ASD 
TR  61-123. 

11.4.  1  Random  Vibration 

Random  vibration  is  that  type  of  time-varying  motion  which 
consists  of  randomly  varying  amplitudes  and  frequencies  such  that  its 
behavior  can  be  described  only  in  statistical  terms.  No  analytical 
representation  for  the  motion  is  possible.  The  motion  does  not  repeat 
itself  in  finite  time  periods.  In  this  report,  a  vibration  response  will 
be  considered  as  random  unless  vibratory  motion  with  a  periodic  form 
is  present.  There  are,  of  course,  other  types  of  vibratory  motions 
that  are  neither  random  nor  periodic.  Included  would  be  those  motions 
which  can  be  represented  by  nonperiodic  analytic  functions,  such  as  an 
exponential  -  sine  function.  However,  it  is  usually  more  suitable  to 
consider  and  analyze  these  motions  as  shock  phenomena  rather  than  as 
vibration. 


ASD  TDR  62-973 


11-6 


11.  4.  2  Stationary  Random  Vibration 


The  term  stationary  is  often  applied  to  random  vibration  data 
in  a  context  that  is  slightly  different  from  its  classical  statistical 
meaning.  Because  the  concept  of  stationarity  is  so  vitally  impor¬ 
tant  to  vibration  environment  prediction  problems,  some  general 
discussion  of  its  meaning  is  included  here. 

Any  particular  random  vibration  response,  whose  amplitude 
time  history  has  been  recorded  for  analysis,  represents  a  unique 
set  of  circumstances  that  are  not  likely  to  ever  be  repeated  exactly. 
A  single  random  vibration  record,  in  actual  practice,  is  merely  a 
special  example  out  of  a  large  set  of  possible  records  that  might 
have  occurred.  This  collection  (ensemble)  of  records  may  be 
thought  of  as  a  random  process,  as  illustrated  in  Figure  11.  1. 

Hypothetically,  the  number  of  records  in  a  random  process 
would  be  infinitely  large  and  each  record  would  exist  over  all  time. 
The  properties  of  the  random  process  may  be  computed  by  taking 
averages  over  the  collection  of  records  at  any  given  time  t.  Such 
averages,  called  ensemble  averages,  will  be  a  function  of  time. 

For  example,  at  time  t,  the  mean  value  Pjf(l).  mean  square 
value  and  the  autocorrelation  function  R„(t,  t)  would  be 

given  by 

u  (t)  =  lirn 
k-*oo 


/mV(t)  =  lim 
^  k-»oo 


R  ( t ,  t)  =  lim 
k^oo 


K 

^2 


X.  (t) 


(11.  la) 


i=l 


i  2 

i=l 


(11.  lb) 


K  Xl^(t)Xj^(t+T)  (11.  IC) 

i  =  l 
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Figure  11.  1  Vibration  Amplitude  Time  History  Records 
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For  the  general  case  where  the  properties  defined  in  Eq.  (If*  f) 
vary  with  time,  the  random  process  is  said  to  be  nonstationary. 

For  the  special  case  where  the  properties  defined  in  Eq.  (11.  1)  do  not 
vary  with  time  (  ^.nd  are  time  invariant),  the  random 

process  is  said  to  be  weakly  stationary.  If  all  possible  moments 
of  the  random  process  determined  by  ensemble  averaging  are  time 
invariant,  the  random  process  is  said  to  be  strongly  stationary. 

In  its  broadest  meaning,  stationarity  is  a  characteristic  of  ensemble 
averaged  properties. 

The  properties  of  individual  records  within  the  random  process 
can  also  be  computed  by  averaging  over  time.  These  time  averages 
will  be  a  function  of  the  specific  record  in  the  collection.  For  the 
ith  record,  the  mean  value  p.  (i),  the  mean  square  value /*>!.«/ (i), 
and  the  autocorrelation  function  i).  would  be  given  by 

p  (i)  =  lim  \  x.(t)  dt  (11.2a) 

T-oo  ' 


/m^(i)  =  lim 
^  T— oo 


R  (t,  i)  =  lim 
T— oo 


■  J 


X  (t)x.(t+T)  dt 


(11.  2c) 


-T 


L  J  xf(t)  dt  (11.2b) 


Let  the  above  time  averaged  properties  be  determined  for  all  possi¬ 
ble  records  of  a  random  process  which  is  at  least  weakly  stationary. 
If  each  property  is  the  same  for  all  records  and  equal  to  the  corres¬ 
ponding  property  determined  by  ensemble  averaging,  the  stationary 
random  process  is  said  to  be  weakly  ergodic.  If  the  random  process 
is  strongly  stationary,  and  the  above  requirements  are  met  for  all 
possible  moments,  ,  the  stationary  random  process  is  said  to  be 
strongly  ergodic.  Thus,  ergodicity  is  a  characteristic  of  time 
averaged  properties  for  a  stationary  random  process. 
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For  the  flight  vehicle  vibration  problem,  a  single  record 
could  represent  the  vibration  response  at  some  point  on  the  struc¬ 
ture  of  a  given  flight  vehicle.  The  collection  of  records  (ensemble) 
would  then  represent  the  vibration  responses  at  that  point  occurring 
during  simultaneous  flights  of  all  vehicles  of  that  type.  The  pro¬ 
cedure  of  measuring  descriptive  properties  of  the  vibration  response 
by  ensemble  averaging  is  clearly  undesirable.  In  order  to  mini¬ 
mize  the  statistical  uncertainty  (sampling  error)  in  the  resulting 
measurements,  a  relatively  large  number  of  simultaneous  flights 
of  different  vehicles  (or  repeated  flights  of  the  same  vehicle)  would 
be  required.  If  data  is  reduced  by  analog  instruments,  the  instru¬ 
mentation  required  to  ensemble  average  a  large  number  of  sample 
records  simultaneously  is  far  more  complex  than  is  required  to 
time  average  the  individual  sample  records.  It  is  for  these  reasons 
and  others  that  the  vast  majority  of  vibration  data  analysis,  in 
actual  practice,  is  accomplished  by  time  averaging  individual 
sample  records  rather  than  by  ensemble  averaging  a  collection  of 
sample  records.  A  slightly  different  concept  for  stationarity  is 
required  when  one  deals  with  vibration  response  data  by  time 
averaging  individual  sample  records. 

An  individual  vioration  response  is  often  referred  to  as  being 
stationary  or  nonstationary.  In  this  case,  the  term  is  used  to  mean 
that  the  properties  of  the  vibration  response,  determined  by  time 
averaging  sample  records  of  finite  length,  do  not  change  "signifi¬ 
cantly”  for  samples  covering  different  time  intervals.  The  word 
significantly  means  that  variations  in  the  sample  values  are  greater 
than  would  be  expected  from  sampling  errors.  This  concept  of 
stationarity  will,  for  the  moment,  be  referred  to  as  self- stationarity 
to  avoid  confusion  with  the  definition  presented  previously. 

To  clarify  the  idea  of  self- stationarity,  consider  an  individual 
vibration  response  x(t).  Assume  a  sample  record  of  length  T  is 
obtained  at  some  starting  time  t^.  In  general,  the  properties 
determined  by  time  averaging  over  the  sample  will  be  a  function  of 
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the  starting  time  t^.  That  is,  for  time  t^,  the  sample  mean  value  x(tQ), 
the  sample  mean  square  value  x^(tQ),  and  the  sample  autocorrelation 
function  R{t, tp)  would  be  given  by 


to  +  T 


x(to)  = 


X  (tg)  = 


1 

—  X 

T  J 


(t)  dt 


if 


0 

t,,  +T 


2,  V  . 

X  (t)  dt 


R(T,t_)  = 


^0  +  ^ 


1  r 
-  I 


(t  +  t)  dt 


(11.  3a) 


(11.3b) 


(11.  3c) 


For  the  general  case  where  the  sample  properties  defined  in  Eq.  (11.  3) 
vary  significantly  with  the  time  tQ  that  the  sample  was  obtained,  the 
individual  vibration  response  is  said  to  be  self-nonstationary.  For  the 
special  case  where  the  properties  defined  in  Eq.  (11.  3)  do  not  vary  signifi¬ 
cantly  with  time  tQ,  the  vibration  response  is  said  to  be  weakly  self¬ 
stationary.  If  the  above  requirement  is  met  for  all  possible  moments, 
the  vibration  response  is  said  to  be  strongly  self  -  stationary. 

It  should  be  noted  that  if  a  vibration  response  is  normally  distributed, 
the  first  two  moments  (mean  value  and  mean  square  value)  will  define  all 
higher  moments.  Thus,  if  it  can  be  shown  that  the  vibration  response  is 
weakly  self- stationary,  this  fact  plus  the  existence  of  normality  makes 
the  response  strongly  self-stationary. 

There  are  many  possible  associations  between  the  self- stationarity 
of  individual  vibration  responses,  and  the  stationarity  and  ergodicity  of  a 
collection  of  vibration  responses.  The  most  important  of  these  associa¬ 
tions  is  as  follows.  Assume  the  vibration  responses  in  many  different 
vehicles  of  the  same  type  are  each  found  to  be  self- stationary,  at  least 
during  some  phase  of  a  common  mission.  Also  assume  the  properties 
of  the  vibration  responses  determined  by  time  averaging  sample  records 
obtained  during  a  self  -  stationary  phase  are  equivalent  from  vehicle  to 
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vehicle.  Then,  the  vibration  response  during  that  phase  is  stationary 
and  ergodic.  The  properties  determined  by  time  averaging  a  short 
sample  record  from  one  vehicle  will  be  estimators  for  the  vibration 
response  to  be  expected  in  all  vehicles  of  that  type  during  the  entire 
phase. 


11.4.3  Normal  (Gaussian)  Random  Vibration 

A  random  vibration  response  x(t)  is  Gaussian  if  it  has  a  specific 
instantaneous  amplitude  probability  density  function  given  by 


Po(’^) 


(11.4) 


Here,  is  the  mean  value  for  the  response,  and  <r^  is  the  mean  square 
value  about  the  mean  (variance)  for  the  response.  Random  vibration 
responses  which  are  described  by  any  other  probability  density  function 
will  be  called  non-Gaussian. 


11.  5  MEAN  SQUARE  VIBRATION  RESPONSE 

For  any  random  signal,  the  mean  square  value,  /m4t  ,  and  the 

2  * 

mean  square  value  about  the  mean  (variance),  cr  ,  are  related  by 

2  2  ^  . 
cr  - /niA'  -  p  .  Thus,  if  the  mean  value  p  is  zero,  the  two  quantities 
jc  2 

are  equal,  and  cr^  defines  the  mean  square  value  of  the  signal.  The 

positive  square  root,  cr^,  is  the  root  mean  square  value  of  the  signal. 

It  will  be  assumed  in  all  discussions  to  follow  that  the  mean  value, 

p^,  for  the  vibration  response  is  zero.  The  mean  value  of  a  vibration 

response  is  a  measure  of  the  steady  state  magnitude  for  the  physical 

parameter  being  measured  (such  as  steady  state  acceleration),  and  would 

appear  as  a  DC  voltage  in  the  output  of  the  vibration  transducer.  Because 

of  the  limited  low  frequency  response  of  most  vibration  data  acquisition 

and  analysis  equipment,  the  mean  value  of  the  vibration  response  is 

usually  rendered  zero  whether  the  mean  value  of  the  actual  physical 

2 

parameter  being  measured  is  zero  or  not.  Hence,  the  term  or^  will  be 
used  in  these  studies  to  denote  the  mean  square  value  of  a  vibration 
response,  as  is  done  in  ASD  TR  6l>123,  where  it  is  understood  that  the 
mean  value  of  the  vibration  response  is  assumed  to  be  zero. 
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12.  UNCERTAINTY  OF  ZERO  CROSSING  ESTIMATES 

12.  1  THEORY  OF  ZERO  CROSSING  ESTIMATION 
12.  1.  1  General  Remarks 

A  procedure  for  testing  the  randomness  of  vibration  amplitude  time 
history  records  is  suggested  in  Section  6.  1.  5  of  Ref.  [  1  ]•  The  proposed 
test  for  randomness  involves  the  application  of  statistical  run  theory  to  the 
prediction  of  zero  crossings  for  continuous  vibration  signal  records.  Before 
that  test  can  be  considered  in  more  detail,  it  is  necessary  to  confirm  the 
validity  of  theoretical  predictions  for  zero  crossings  of  random  signals. 

The  actual  proposed  test  for  randomness  using  zero  crossing  data  is  studied 
in  Section  15  of  the  report. 

12.  1.  2  Review  of  Basic  Concepts 

Consider  an  event  which  can  occur  in  only  two  mutually  exclusive  ways 
that  is,  the  outcome  must  be  either  A  or  B.  For  example,  the  event  may  be 
the  flip  of  a  coin  where  the  outcome  will  be  either  a  head  (A),  or  a  tail  (B). 
As  another  example,  the  event  may  be  a  gage  pressure  reading  where  the 
outcome  will  be  either  a  positive  pressure  (A)  or  a  negative  pressure  (B) 
relative  to  gage  reference.  Now  assume  the  experiment  producing  the  event 
is  repeated  n  number  of  times  in  sequence,  such  as  a  coin  being  flipped  20 
times  in  succession.  The  outcomes  of  the  sequence  of  events  might  be  as 
follows. 

B  A  ^  A^  BAHAMA  ^B 
1  2  3  4  5  6  7  8  9  10  11  12 

A  run  is  defined  as  a  sequence  of  identical  outcomes  which  are  followed  or 
preceded  by  a  different  outcome  or  no  outcome  at  all.  In  the  above  example 
the  sequence  of  20  events  resulted  in  12  runs.  The  total  number  of  runs  in 
any  observed  sequence  of  events  gives  an  indication  of  whether  or  not  the 
events  occur  randomly. 

Given  a  sample  of  n  number  of  events,  let  n^  be  the  number  of 
events  with  an  outcome  A,  and  let  n^  be  the  number  of  events  with  an  out¬ 
come  B.  Clearly,  n  =  n^  +  n^.  Also,  let  r  be  the  number  of  runs  which 
occur  in  the  sample.  If  the  events  occur  randomly,  and  if  n^  and  n^  are 
greater  than  20,  it  is  shown  in  Ref.  [  s]  that  a  good  approximation  for  the 
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amplitude 


sampling  distribution  of  r  is  a  normal  distribution  with  a  mean  of  and 
a  variance  of  cr^  given  by, 


^"r  « 


+  1 


(12.  1) 


O’ 


2 

r 


2n^n2(2njn2  -  n) 
n^(n  -  1) 


(12,  2) 


12.  1,  3  Development  for  Vibration  Signal  Records 

Consider  a  sample  vibration  amplitude  time  history  record  of 
length  T,  as  shown  in  Figure  12.  1. 


Figure  12.  1  Sample  Vibration  Amplitude  Time  History  Record 


For  simplicity,  the  mean  value  of  the  vibration  signal  being  sampled  is 
assumed  to  be  zero;  i.  e.  ,  no  DC  component  is  present.  This  is  usually 
the  actual  case  in  practice. 

Assume  that  the  total  number  of  events  represented  by  the  sample 
record  of  length  T  is  some  number  n,  still  to  be  defined.  Let  the  two 
possible  outcomes  of  each  event  be  either  a  positive  amplitude  value  or  a 
negative  amplitude  value.  Then,  a  zero  crossing  constitutes  the  end  of  one 
run  and  the  beginning  of  another,  as  shown  in  Figure  12.  1.  The  total 
number  of  runs  r  in  a  given  sample  record  will  always  be  one  greater  than 
the  total  number  of  zero  crossings  That  is, 

r  =  V^  +  I  (12.  3) 
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Furthermore,  the  total  time  that  the  signal  has  a  positive  amplitude  value 
will  be  approximately  equal  to  the  total  time  that  the  signal  has  a  negative 
amplitude  value.  Then,  it  may  be  assumed  that 

1 

^  oti  -  n  (12.  4) 

When  applying  these  ideas  to  actual  vibration  signals,  one  would 
determine  the  number  of  runs  in  a  sample  record  by  counting  the  number 
of  zero  crossings  that  occur  over  the  record  length.  Thus,  it  will  be  more 
practical  to  work  directly  with  zero  crossings  rather  than  runs.  Noting 
Eq.  (12.  3),  the  mean  and  variance  of  zero  crossings  are  related  to  the  mean 
and  variance  of  the  runs  as  follows. 


(12.5) 

2  2  2 

(12.6) 

=‘"(r-l)=‘"r 

If  the  vibration  signal  being  sampled  is  random,  by  substituting  £qs.(12.  1), 
(12.  2),  and  (12,  4)  into  Eqs.  (12.  5)  and  (12.6),  the  sampling  distribution 
for  zero  crossings  will  have  a  mean  and  variance  given  by 


n 

1 


2(n-  1) 


(12.  7) 


(12.8) 


It  now  remains  to  define  the  number  of  events  n  that  are  represented  in  a 
sample  record  of  length  T. 

In  Ref.  [  ij,  the  number  of  events  n  was  considered  to  be  the  number 
of  degrees  of  freedom  of  the  sample  record  given  by  n  =  2BT,  where  B 
is  the  frequency  bandwidth  in  cps  after  filtering  by  an  ideal  low  pass  filter 
with  an  infinitely  sharp  cutoff.  However,  this  definition  for  n  is  not  con¬ 
sistent  with  the  results  of  theoretical  studies  of  zero  crossings  for  random 
signals.  From  Ref.  ^  2j,  the  expected  number  of  zero  crossings  for  a 
random  signal  record  of  length  T  seconds  with  a  low  pass  frequency  band¬ 
width  of  B  cps  is  given  by 

p  1.  15  BT  (12.  9) 
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If  the  number  of  events  is  defined  as  n  =  2BT,  from  Eq.  (12.  7)  the  expected 
number  of  zero  crossings  would  be 


1.  00  BT 


(12.  10) 


Because  the  problem  at  hand  is  directly  concerned  with  zero  crossings,  the 
results  presented  in  Ref.  ^2j,  as  stated  in  Eq.  (12.  9),  will  be  accepted  as 
a  basis  for  defining  the  number  of  events  n.  The  validity  of  this  decision 
will  be  substantiated  by  experimental  results  to  be  presented  later. 

Again  referring  to  Ref.  ^  2j,  the  general  equation  for  the  expected 
number  of  zero  crossings  per  second,  ,  for  a  random  signal  with  a 
frequency  bandwidth  between  the  limits  f  cps  and  f,  cps  is  given  by 

2l  O 

(12.  11) 

where  it  is  assumed  that  the  random  signal  has  the  following  properties. 

(a)  an  infinitely  sharp  cutoff  at  frequencies  f^  and  fj^. 

(b)  a  uniform  power  spectral  density  function  over  the  frequency 
range  between  f  and  f,  . 

(c)  a  Gaussian  amplitude  probability  density  function. 


If  the  random  signal  being  investigated  does  not  possess  the  above  character¬ 
istics,  the  equation  for  expected  zero  crossings  per  unit  time  becomes  some¬ 
what  more  complex.  However,  Eq.  (12.  II)  may  still  be  an  acceptable  approxi¬ 
mation  for  practical  purposes.  The  importance  of  the  above  assumptions 
will  be  considered  in  more  detail  later. 

From  Eq.  (12.  11),  the  expected  number  of  zero  crossings  in  a 
sample  record  of  length  T  is 


(12.  12) 


Comparing  Eq.  (12.  12)  with  Eq.  (12.  7),  the  number  of  events  n  in  a  sample 
record  of  length  T  may  then  be  defined  as 


where  ^  is  given  by  Eq.  (12.  11). 


(12.  13) 
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12.  2  DESIGN  OF  EXPERIMENTS  AND  PROCEDURES 
12.  2.  1  General  Design  and  Procedures 

The  experiments  to  be  conducted  are.  designed  to  investigate  the 
sampling  distribution  of  zero  crossings  and  confirm  the  validity  of  the 
theoretical  results  given  in  Eqs.(12.  7)  and  (12.8).  Experiments  are  also 
designed  to  study  the  practicability  of  the  theoretical  results  in  terms  of 
simulated  vibration  data.  The  sampling  distribution  of  zero  crossings  are 
investigated  for  random  and  non-random  signals  in  three  basic  areas. 

Area  A.  random  signals  which  have  approximately  Gaussian 

probability  density  functions  and  uniform  power 
spectral  density  functions. 

Area  B.  random  signals  which  have  approximately  Gaussian 

probability  density  functions  and  non-uniform  power 
spectral  density  functions. 

Area  C.  non- random  signals  composed  of  a  sine  wave  mixed 

with  a  random  signal. 

For  all  three  areas  of  study,  the  basic  procedure  is  to  gather  some 
large  number  N  of  sample  records  from  a  simulated  vibration  signal  of 
interest.  The  number  of  zero  crossings,  ,  in  each  of  the  N  number  of 
samples  is  counted.  The  mean  value  and  variance  of  the  sampling  distri¬ 
bution  are  then  estimated  as  follows: 


Vr 


N 


(12.  14) 


A  .2 


u 


2n 


o . 


N 


(12.  15) 


A  biased  variance  estimate  is  employed  here  so  that  all  statistical  P 
procedures  to  follow  will  be  consistent  with  procedures  outlined  in  Ref.  I  1 
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For  experiments  in  Area  A,  if  the  theoretical  expected  value  of  the 
sampling  mean  p.  .  defined  by  Eq.  (12.  7)  is  valid,  the  estimated  sampling 

mean  Pj.  given  by  Eq.  (12.  14)  should  be  statistically  equivalent  to  p.. 

Likewise,  the  estimated  sampling  variance  a.  .  from  Eq.  (12.  15)  should 

be  statistically  equivalent  to  the  theoretical  expected  value  for  the  sampling 
2 

variance  cr  defined  by  Eq.  (12.  8).  The  equivalence  of  the  experi- 
Ia> 

mentally  estimated  and  theoretical  expected  values  are  studied  by  testing 

2 

the  null  hypotheses,  H^(o'  )  and  H^(p),  where 

«  /  2,  ^2  2 

^  ’ll 


Hod*) 


The  null  hypothesis,  H^(o’  ),  is  tested  by  a  chi-square  test  of  variances. 

2  ^2  2 
If  H  (o'  )  is  accepted,  there  is  no  reason  to  question  that  a.  .  =  .  > 

2  ^ 
and  the  theoretical  value  for  <r  defined  in  Eq.  (12.  8)  is  considered 

2  ^  2  2 
valid.  If  H  (o'  )  is  rejected,  there  is  reason  to  question  that  "a  -  j  » 

°  Uo  L/d 

2  ,  2,  . 

and  the  theoretical  value  for  cr.  is  questioned.  Assuming  H  (o'  )  is 

to  ° 

accepted,  H^(hl)  Is  then  tested  by  a  Normal  test  of  means.  The  theoretical 

expected  value  for  p  defined  in  Eq.  (12.  7)  is  considered  valid  if  H^(p) 

o 

is  accepted,  or  questioned  if  H^(h^)  is  rejected.  Note  that  the  variances 

must  be  tested  first  because  the  Normal  test  of  mean  values  requires  a 

2 

known  variance.  However,  if  H^(®'  )  is  rejected,  H^(k)  can  still  be  tested 
by  a  student's  "t"  test  which  uses  the  sample  variance. 

Assuming  the  validity  of  Eqs.  (12.  7)  and  (12.  8)  are  confirmed  by 
experiments  in  Area  A,  the  procedure  for  testing  the  null  hypotheses  is 
continued  for  the  results  of  experiments  in  Areas  B  and  C.  The  practicability 
of  the  theoretical  ideas  will  be  indicated  in  part  by  whether  or  not  the 
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null  hypotheses  are  accepted  or  rejected  when  applied  to  results  in  Area  B. 
Clearly,  it  is  hoped  that  the  null  hypotheses  will  be  rejected  for  results 
in  Area  C. 

The  Type  I  and  Type  II  errors  associate'd  with  the  null  hypothesis 
tests  are,  of  course,  a  function  of  the  nunaber  N  of  samples  gathered  and 
tested.  For  all  experiments  the  number  of  samples  gathered  is  chosen  to 
be  N  =  31.  The  hypothesis  tests  are  applied  at  the  10%  level  of  significance, 
giving  a  probability  of  a  Type  I  error  of  a  =  0.  10.  The  associated  proba¬ 
bility  of  a  Type  II  error  is  P  =  0.  10  for  detecting  a  6%  difference  in  means 
and  2.  4  to  1  difference  in  variances  (50%  difference  in  standard  deviations). 
The  development  of  these  probable  errors  and  the  sample  size  of  N  =  31  is 
presented  in  Section  12.  2.  2. 


12.  2.  2  Sample  Size  Calculations  for  Equivalence  of  Means  and  Variances 

In  any  situation  where  one  knows  or  hypothesizes  a  mean  and  variance 
of  a  distribution,  one  may  compute  sample  sizes  necessary  to  properly  test 
sample  values  against  these  theoretical  values.  Certain  constraints  must 
be  imposed  on  the  problem,  such  as  specifying  the  level  of  significance  and 
probability  of  Type  II  error,  which  will  be  explained  below.  The  sample 
size  may  then  be  calculated  which  maintains  these  probabilities. 

A  theoretical  mean  p.  and  variance  cr  ^  can  be  computed  for  a 

distribution  of  zero  crossings  from  Eqs.  (12.  7)  and  (12.  8).  Using  these 
theoretical  values,  one  can  then  test  obtained  sample  values  against  these 
to  determine  if  the  observed  distribution  of  zeros  can  be  considered  to  be 
the  same  as  the  theoretical  distribution.  That  is,  the  statistical  hypothesis 
will  be:  there  is  no  evidence  to  conclude  that  the  sample  values  are  not  the 
same  as  the  theoretical  values.  These  will  be  two-tailed  tests  since 
deviations  may  occur  in  either  direction 

Two  types  of  errors  can  be  made; 


Type  I  error  -  rejecting  the  hypothesis  when  it  is 
really  true  with  probability  a 

Type  II  error  -  accepting  the  hypothesis  when  it  is 
really  false  with  probability  P 

In  addition  to  specifying  a  and  P,  one  must  impose  an  additional 
restraint  on  the  problem  to  allow  the  sample  size  to  be  calculated.  That  is, 
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one  must  specify  what  particular  deviation  from  the  hypothesized  parame¬ 
ter  will  allow  the  hypothesis  to  be  accepted  with  probability  p.  In  some 
specific  situations  one  might  have  suspicions  about  the  theory  involved 
and  anticipate  some  particular  value  other  than  the  hypothesized  value. 

In  other  cases,  one  must  use  judgment  in  selecting  values  somewhat 
arbitrarily. 

For  the  experimental  program,  a  ten  percent  difference  in  means 
and  a  fifty  percent  difference  in  standard  deviations  will  be  selected  as 
the  values  at  which  the  probability  of  Type  II  error  will  be  held.  Of 
course,  other  deviations  from  the  theoretical  values  may  be  chosen,  and 
have  a  specific  associated  probability  of  the  hypothesis  being  accepted. 
Also,  for  simplicity,  a  and  b  will  be  chosen  each  equal  to  10%. 

(a)  Sample  Size  for  Equivalence  of  Means 

The  calculation  of  the  required  sample  size  for  the  test  of  equivalent 
mean  values  is  as  follows;  Let  p!  be  the  mean  value  of  the  distribution 
which  is  to  be  detected  with  a  probability  P  =  10%,  and  ^  normal 

(Gaussian)  deviate  such  that 

Prob(  Z  r 

The  reason  for  using  a/2  instead  of  a  is  to  allow  for  two-sided  devia¬ 
tions  so  that  the  Type  I  error  here  is  a. 

The  following  relations  now  hold  where  x^  is  the  critical  point 
(see  Figure  1).  That  is,  x^  is  a  value  such  that  if  ic^x^  ,  the  hypothesis 
IS  rejected,  and  if  x*  x^  ,  the  hypothesis  is  accepted  where  x  is  the 
calculated  sample  mean. 

Figure  1  is  not  quite  complete  in  the  sense  that  deviations  in  either 
direction  are  considered.  However,  the  symmetry  is  implied  by  using 
a/ 2  and  P/2  rather  than  a  and  p.  In  terms  of  a/ 2, 


^hile,  in  terms  of  P/2, 


^1-0/2 


X  -  u ' 

c 

(r/'\nr 


(12.16) 


(12.17) 
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where  o’  is  the  theoretical  variance,  Eq.  (12.  8),  of  the  distribution  of 
zero  crossings  (the  subscripts  are  being  omitted  for  simplicity). 


Prob  (x  x:  )  =  a/2 
'  —  c 

Prob  (x  2  x^)  =  P/2 


;  Type  I  error 
;  Type  II  error 


In  the  special  situation  where  one  sets  a  =  P,  it  follows  that 
Z^/2  =  ^p/2  •  Also,  due  to  the  symmetry  of  the  normal  distribution, 
^l-a/2  “*^q/2  ■  Hence,  from  Eqs.  (12.  16)  and  (12.  17), 


X  -  u.  X  -  u 

c  c  ^ 


o-/V^  cr/V17 


Solving  for  x^  one  obtains 


_  hi  + 


2 

Then  substituting  back  in  Eq.  (12.  17),  replacing  P  by  a. 


(12. 


p  +  p. '  ,  HI  -  P  ' 

— 2 - — 2 - 

^a/2  ^  ^  ■^l.a/2 


•/Vir  (T/^n^ 
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Letting  =  M-  -  K  '  and  solving  for  N: 


N  = 


2 

(T 


(Afi/2)^ 


(12.19) 


Eq.  (12.  19)  is  a  general  result  which  is  applicable  to  many  problems. 

2  ,  2 

Note  that  the  implicit  assumption  has  been  made  that  cr  =  (cr')  where 

2 

(a')  is  the  alternative  variance.  Therefore  this  test  would  be  per- 

2 

formed  after  the  alternative  variance  (cr')  had  been  determined  to  be 

2 

statistically  equivalent  to  the  theoretical  value  o'  . 


(b)  Computational  Example 

The  calculation  of  N  based  on  the  test  for  equivalent  means  is  as 
follows.  For  n  =  iOO  effective  events,  one  obtains  from  Eqs.  (12.  7)  and 
(12.  8)  the  theoretical  values 


50 

25 


The  required  sample  size  to  detect  a  10%  difference  in  means  (namely 

Ap  =  5  here)  with  a  Type  II  error  of  P  =  10%  then  is  calculated  by 

applying  Eq.  (12.  19).  For  a  =  10%,  the  term  Z  =  -1.645.  Thus, 

.05 


from  Eq.  (12.  19), 


(1. 645)^ 


11 


This  sample  size  of  N  -  11  will  be  compared  later  to  the  sample  size 
required  for  equivalent  variances. 


(c)  Sample  Size  for  Equivalence  of  Variances 

The  reasoning  for  obtaining  a  formula  to  compute  the  sample  size 

2 

for  the  variance  equality  test  proceeds  in  a  similar  manner.  Let  s 

2  2  2  . 

represent  the  critical  point.  Then,  since  N  s  /o'  has  a  x  distribution 
with  (n  -  I)  d.  f.  ,  one  has 


(12.20) 


and 


2  (0-')^  2 
s  =  -1 — '  X 

N  I-P/2 


(12.21) 
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2  2  2 

where  Xj3/2  a/2  points  of  the  x  distribution  with  (N  -  1)  d.  f. 

Equating  (12.  20)  and  (12.  21)  and  rearranging  terms,  one  obtains  the 
general  result 


X 

a 


\-.n 


(12.22) 


for  the  case  when  a  =  p.  Although  the  N  cancels  out,  x  is  a  function 

2  2 

of  (N  -  1).  Therefore,  when  cr  and  (cr'  )  are  specified,  a  trial  and 

2  2 

error  inspection  of  a  x  table  will  give  values  of  x  for  some  number 
of  d.  f.  such  that  Eq.  (12.  22)  holds  true. 


(d) 


Computational  Example 

2 

For  example,  for  (N  -  1)  =  30  d.  f.  and  a  =  10%,  one  finds  in  the  x 


table 


2 

05  _  43.  8 

~i  18. 5 
X 


2.  37 


For  all  practical  purposes  this  corresponds  to  the  desired  ratio  of 
standard  deviations  of  1.  5  to  1.  0.  Therefore,  a  convenient  sample  size 
for  the  experiments  is  31. 

Note  that  the  variance  equivalence  test  has  a  larger  required 
sample  size  than  the  mean  equivalence  test,  namely  N  =  31  as  compared 
to  N  =  11,  and  therefore  determines  the  over -all  sample  size  for  the 
experiments.  Since  N  =  31  instead  of  N  =  11,  from  Eq.  (12.  19)  one 
finds  that  the  experiment  will  now  detect  a  6%  difference  in  means 
(A|jl=  3)  while  still  maintaining  a  Type  II  error  of  10%. 


12.  2.  3  Acceptance  Regions  for  Hypothesis  Tests 
(a)  Chi-Square  Test  of  Variances 

- A  2 

For  N  =  31  sample  records,  the  estimated  sampling  variance  (r 
will  be  distributed  about  the  true  sampling  variance  a.  .  as  follows. 


/«.  2 


X^30) 

31 


Vr 
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where  x  (30)  is  a  chi-square  distribution  with  (N  -  1)  =  30  degrees  of 
freedom,  and  the  symbol  ~  means  "distributed  as.  "  From  Table  5.  3 
of  Ref.  [  ^  ]>  a  10%  level  of  significance 


X^(30) 


0.  05 


X^30) 


=  1.  412 


0.  95 


=  0.  5965 


Then  the  acceptance  region  for  testing  the  null  hypothesis  will 

be  as  follows:  o 


A  2 

0.  5965  2  - -  *  1.  412 

2 


(12.23) 


If  the  variance  ratio  falls  within  the  limits  stated  in  Eq.  (12.  23),  H^(o’  ) 

will  be  accepted.  If  the  variance  ratio  falls  outside  the  limits  stated, 

2 

H^((r  )  will  be  rejected. 

(b)  Normal  Test  of  Mean  Values 

For  N  =  31  sample  records,  the  estimated  sampling  mean  p.  . 
will  be  distributed  about  the  true  sampling  mean  as  follows. 


-  K  .  )  ~  Norm  0  ;  - 2 

Vn  Vr.  \  31 


where  Norm  (0  ;  cr  /  31)  is  a  Normal  distribution  with  a  mean  of  zero 

2  r  1 

and  a  variance  of  <r  /  31.  From  Table  5.  2  of  Ref.  I  IJ,  for  a  10% 

level  of  significance 


Norm  I  0 ; 


=  -  Norm  0  ; 


0.  05 


=  ±  1.  645 


0.  95 


Then  the  acceptance  region  for  testing  the  null  hypothesis  H^(p)  will 
be  as  follows. 


1.645  ^  ,A  ,  1.645 

717 


(12.24) 
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If  the  mean  difference  falls  within  the  limits  stated  in  Eq.  (12.  24), 
will  be  accepted.  If  the  mean  difference  falls  outside  the  limits  stated, 
H^(p)  will  be  rejected. 


(c) 


Student's  "t"  Test  of  Mean  Values 


Consider  the  case  where  the  variance  test  (a)  rejects  the  null 
hypothesis  H^(cr  ).  It  is  still  of  interest  whether  or  not  the  estimated 
sampling  mean  is  equivalent  to  the  expected  sampling  mean  for  a  random 
signal.  However,  in  the  absence  of  a  known  expected  value  for  the 
sampling  variance  <t^  ,  the  estimated  sampling  variance  must  be 


o  "  o 

used  to  establish  a  region  of  acceptance  for  a  hypothesis  test. 

For  N  =  31  sample  records,  the  estimated  sampling  mean 

be  distributed  about  the  true  sampling  mean  (jl.  .  as  follows.  ^ 


will 


2 

where  t(0  ;  /  30)  is  a  "t"  distribution  with  N  -  1  =  30  degrees  of 

freedom,  a  m^an  of  zero,  and  a  variance  From  Table 

5.  4  of  Ref.  [  1  ]  »  for  a  10%  level  of  significance® 


t 


0.  05 


=  -  t 


0.  95 


0  ; 


A  2 

30 


1.  70  A 

Vo 


Then,  the  acceptance  region  for  testing  the  null  hypothesis  will 

be  as  follows. 


1.  70  A 

■  Vlo  Vo 


1.  70  A 
V~30  ^o 


(12.25) 


If  the  mean  difference  falls  within  the  limits  stated  in  Eq.  (12.  25),  H^(M') 
will  be  accepted.  If  the  mean  difference  falls  outside  the  limits 
stated,  H^(h^)  will  be  rejected. 
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i  2 .  2 .  4  Procedure  for  Experiments  in  Area  A 


A  random  signal  with  an  approximately  uniform  power  spectrum 
and  Gaussian  amplitude  probability  density  function  is  sampled  for  three 
different  frequency  ranges,  as  follows. 


A-1. 

f 

a 

30 

cps, 

'b 

2000 

cps 

A-2. 

f 

a 

30 

cps, 

^b 

1000 

cps 

A-3. 

f 

a 

^iilOO 

cps , 

'b 

600 

cps 

The  above  frequency  limits  are  only  approximate  because  a  more  precise 
value  for  f^  and  f^  must  be  calculated  from  the  filter  response 
characteristics,  as  is  discussed  in  Section  12.  3.  2. 

The  frequency  range  for  test  A-1  represents  the  maximum  frequen¬ 
cy  response  range  of  the  instrumentation  employed.  Test  A-2  is  con¬ 
ducted  to  permit  statistical  tests  for  a  different  range  of  frequencies. 

The  frequency  limits  selected  for  test  A-3  constitute  the  frequency 
range  of  the  predominate  excitation  from  large  turbo-jet  engines. 

For  each  frequency  range  31  sample  records  are  collected,  each 
representing  at  least  100  events.  The  number  of  zero  crossings  in 
each  record  is  counted  and  analyzed  as  described  in  Sections  12.  2.  1 
and  12.  2.  3. 

12.  2.  5  Procedure  for  Experiments  in  Area  B 

A  random  signal  with  an  approximately  Gaussian  amplitude 
probability  density  function  and  a  frequency  range  of  about  100  cps  to 
600  cps  is  sampled  for  four  different  power  spectra.  The  power 
spectrum  of  the  signal  is  altered  by  shaping  filters  which  introduce 
sharp  peaks  into  the  spectrum.  All  four  power  spectra  conditions  are 
obtained  using  a  filter  with  a  very  narrow  bandwidth  and  a  peak  response 
of  10:1,  corresponding  to  a  power  spectrum  peak  of  100;1.  The  sharp 
filtering  is  intended  to  simulate  a  resonant  structural  response.  The 
four  filter  conditions  are  as  follows. 

B-1.  A  single  peak  at  150  cps 
B-2.  a  single  peak  at  350  cps 
B-3.  A  single  peak  at  550  cps 

B-4.  Three  peaks  at  the  three  frequencies  in  B-1 
through  B-3 
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The  detailed  characteristics  of  the  sharp  filters  used  to  obtain  the 
peaks  are  presented  in  Section  12.  3.  3. 

For  each  power  spectrum  condition,  31  sample  records  are  collected, 
each  representing  at  least  100  events.  The  number  of  zero  crossings  in 
each  record  is  counted  and  analyzed  as  described  in  Sections  12.  2.  1  and 
12.  2.  3, 

12.  2.  6  Procedure  for  Experiments  in  Area  C 

A  nonrandom  signal  is  created  by  superimposing  a  sinusoidal  com¬ 
ponent  in  a  random  signal  with  an  approximately  uniform  power  spectrum 
and  Gaussian  amplitude  probability  density  function.  Let  f^  be  the  frequen¬ 
cy  of  the  sine  wave  component,  let  MS(sine)  be  the  mean  square  value  of  the 
sine  wave  component,  and  let  MS(random)  be  the  mean  square  value  of  the 
random  component. 

The  nonrandom  signal  is  sampled  for  nine  conditions  as  follows: 

C-l  through  C-4.  ^  cps,  f^^  1000  cps 

MS{sine)  =1/4  MS(random) 

C-l.  f^  =  200  cps 

C-2.  f  =  400  cps 

o 

C-3.  f  =  600  cps 

o 

C-4.  f^  =  800  cps 

C-5  through  C-9.  f^  100  cps,  fj^  ^  600  cps 
MS(sine)  =  MS(random) 


C-5. 

o 

II 

150 

cps 

C-6. 

f  = 
o 

250 

cps 

C-7. 

f  = 
o 

350 

cps 

C-8. 

f  = 
o 

450 

cps 

C-9. 

f  = 
o 

550 

cps 

For  each  condition  of  nonrandomness,  31  sample  records  are 
collected,  each  representing  at  least  100  events.  The  number  of  zero 
crossings  in  each  record  is  counted  and  analyzed  as  described  in 
Sections  12.  2.  1  and  12.  2.  3. 
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12.3  INSTRUMENTATION 

12.  3.  1  Instruments  and  Test  Sfet-Up 


The  laboratory  instruments  employed  for  the  experiments  are  listed 
in  Table  12.  1.  All  instruments  were  in  current  calibration  at  the  time 
of  the  experiments.  A  block  diagram  for  the  test  set-up  is  illustrated  in 
Figure  12.3. 

The  random  noise  generator  (Item  A)  is  used  as  the  source  of  a 
signal  which  is  considered  in  these  experiments  to  be  truly  random.  The 
manufacturer's  data  indicates  the  instrument  generates  a  random  signal 
with  an  approximately  Gaussian  amplitude  probability  density  function  and 
a  reasonably  uniform  power  spectral  density  function  for  frequencies  from 
30  cps  to  20  kcps.  Actual  measurements  of  the  noise  generator's  charac¬ 
teristics  are  presented  in  Section  14.  3.  The  voltmeter  (Item  B)  is  used 
to  measure  the  rms  voltage  level  of  the  random  signal  being  delivered. 

The  sine  wav'e  generator  (Item  C)  is  used  as  the  source  of  a  signal 
which  IS  known  to  be  nonrandom.  The  voltmeter  (Item  D)  is  used  to 
measure  the  rms  voltage  level  of  the  sinusoidal  signal  being  delivered. 

The  frequency  counter  (Item  E)  is  used  to  determine  the  frequency  of  the 
sinusoidal  signal  with  an  accuracy  of  ±  1  cps. 

The  sine  wave-random  noise  mixer  (Item  F)  is  used  to  create  a 
signal  with  controlled  and  defined  nonrandom  characteristics.  The 
variable  band  pass  filter  (Item  G)  is  used  to  band- limit  the  frequency 
range  of  the  signal  to  be  investigated.  The  characteristics  and  cali¬ 
bration  of  this  filter  are  discussed  in  Section  12.  3.  2, 

The  shaping  fillers  (Item  H)  are  used  to  obtain  a  signal  with  a  non- 
uniform  power  spectrum.  Five  peaks  or  notches  may  be  inserted  to 
simulate  structural  response  modes.  The  characteristics  of  these 
filters  are  discussed  in  Section  12.  3.  3. 

The  voltmeter  (Item  I)  is  used  to  measure  the  rms  voltage  level 
of.  the  signal  to  be  investigated.  The  oscilloscope  (Item  J)  is  used  to 
display  the  signal  amplitude  time  history  for  qualitative  observation. 

The  power  amplifier  (  Item  K)  is  used  to  obtain  a  sufficient  signal 
current  to  operate  the  galvanometer  oscillograph.  The  galvanometer 
oscillograph  (Item  L)  is  used  to  record  amplitude  time  history  samples 
of  the  signal  to  be  investigated.  The  galvanometers  employed  have  a 
uniform  frequency  response  from  0  to  2000  cps. 
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Item 

Description 

Manufacturer 

Model 

No. 

Serial 

No. 

A 

Random  Noise  Generator 

General  Radio  Company 

1390A 

937 

B 

True  RMS  Voltmeter 

Ballantine  Laboratories 

320 

581 

C 

Sine  Wave  Generator 

Hewlett  Packard 

200  AB 

5631 

D 

AC  Voltmeter 

Hewlett  Packard 

400  H 

2075 

E 

Frequency  Counter 

Computer  - 

Measurements  Co. 

200  B 

6320 

i 

Sine  Wave -Random 

Noise  Mixer 

Thompson  Ramo 
Wooldridge  Inc.  , 

RW  Division 

— 

— 

B 

Variable  Band  Pass 

Filter 

Krohn  Hite  Corp. 

330-M 

1484 

H 

Shaping  Filters 
(bank  of  five  peaks 
and  notches) 

Space  Technology 
Laboratories 

— 

I 

True  RMS  Voltmeter 

Ballantine  Laboratories 

320 

1149 

J 

Cathode  Ray  Oscillo¬ 
scope 

Tektronix,  Inc. 

531 

3190 

K 

Power  Amplifier 

McIntosh  Company 

A-116-B 

12629 

L 

Galvanometer 

Oscillograph 

Minneapolis -Honeywell 

1012 

307 

Table  12.  1  Instruments  Employed  for  the  Experiments 
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Random  Noise 
Generator 
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Figure  12,  3  Block  Diagram  of  Test  Set-Up 


12.  3.  2  Evaluation  and  Calibration  of  Variable  Band  Pass  Filter 


The  number  of  everts  n  represented  by  a  sample  record  of  length 
T,  as  given  in  Eq.(12.13)is  directly  proportional  to  the  expected  number  of 
zero  crossings  per  second  as  defined  by  Eq.(  12. 1  l),The  value  of  ^  is 

based  upon  the  frequency  bandwidth  of  the  signal  assuming  infinitely  sharp 
lower  and  upper  frequency  limits  of  f  and  f,  ,  respectively.  Of  course, 
ideally  sharp  frequency  cut-offs  are  not  physically  realizaole.  However, 
given  a  filter  with  a  frequency  response  function  H(f),  the  effective  cut-off 
frequencies  equivalent  to  and  f^^  can  be  computed.  From  Refs.  ^l|  and 
2|,  the  effective  bandwidth  of  a  band  pass  filter  as  seen  by  a  random 

signal  with  a  uniform  power  spectrum  is  defined  by 


®N  =  'b  - 


■r 


H(f) 
H 


df 


(12.  26) 


max 

The  term  B^  is  8»metimes  called  the  noise  bandwidth  of  the  filter. 
The  integration  in  Eq(  12.26)  may  be  accomplished  in  two  parts  as  follows. 


df  =  B  +  B. 
a  b 


(12.  27) 


where  f^  is  some  frequency  at  which  |H(f)|  =  •  Then,  B^  gives  a 

noise  bandwidth  from  f  to  an  effective  low  frequency  cut-off  (f  ),  and  B. 

C  St  & 

gives  a  noise  bandwidth  from  f^  to  an  effective  high  frequency  cut-off  (f^)> 
That  is. 


(12.  28) 
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Rearranging  the  terms  in  Eq^  12.28)  and  substituting  from  Eq.  (12,  27),  the 
effective  frequency  cut-offs  for  any  band  pass  filter  are  given  by, 


f  =  f  - 
a  c 


f.  =  f  + 
b  c 


(12.  29) 


The  cut-off  characteristics  of  the  band  pass  filter  employed  in  these 
experiments  have  been  carefully  determined  for  the  three  frequency  band- 


widths  used.  The  results  are  presented  in  Figs.  12,4,  12.5,  and  12.6.  Both  the 
quantities  |H(f)|  and  jH(f)|^  are  shown  for  j  =  unity.  The  low 

frequency  cut-off  characteristics  of  the  filter  were  studied  only  for  the 


case  were  f  100  cps. 

di 

The  quantity  |H(f)|^(H  =  1)  was  integrated  by  graphical  techniques 

for  each  of  the  three  high  frequency  cut-off  conditions  and  the  low  frequency 
cut-off  condition  of  f  ^  100  cps.  The  resulting  effective  cut-off  frequencies, 

3l 

when  compared  to  the  half  power  point  frequencies  fj^^,  are  approximately 
5%  higher  or  lower  than  fj^^  for  the  high  frequency  or  low  frequency  cut-off, 
respectively.  Hence,  the  effective  cut-off  frequencies  for  the  variable 
band  pass  filter  employed  in  these  experiments  are  considered  to  be  as 
follows. 


f^  =  0,  95  fj^p  (low  frequency  cut-off) 
fj^  =  1.  05  fj^  (high  frequency  cut-off) 
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-25i  100  cps  ~i  600  cps 


FREQUENCY  -  CPS 

Figure  12.  4  Variable  Band  Pass  Filter  Characteristic 
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1.0 


f  30  cps 

3. 


1000  cps 
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2000  cps 


f  cii  30  cps 
a 

1.0 


j }  I  , 

30  100  300  1000  3000 

FREQUENCY  -  CPS 

Figure  12.  6  Variable  Band  Pass  Filter  Characteristic 
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12.  3.  3  Characteristics  of  Shaping  Filters 


The  frequency  response  characteristics  of  the  three  narrow  band  peak 
filters,  as  employed  for  these  experiments,  are  illustrated  in  Figure  12.7. 

The  frequency  cut-offs  for  the  variable  band  pass  filter  are  set  for  f  iOO  cps 
and  f^^5j600  cps.  All  three  peaks  are  shown  together.  For  the  experiments, 
any  two  of  the  three  peaks  are  bypassed  as  required  for  the  procedure  in 
Section  1 2.  2.  5. 

12.  3.  4  Other  Instrument  Evaluations  and  Calibration  Errors 

There  are,  of  course,  numerous  possible  errors  associated  with  the 
calibrations  of  all  the  instruments  employed  for  the  experiments.  However, 
most  of  these  calibration  errors  are  not  really  significant  in  terms  of  the 
end  data  being  sought;  namely,  the  number  of  zero  crossings  by  a  random 
signal  in  a  specific  period  of  time.  FromEqs.  ( 1 2. 1 1 )  and  ( 1 2. 1 3),  it  is  clear  that 
the  major  direct  sources  of  error  in  the  end  data  are  as  follows. 

(a)  error  in  the  effective  high  frequency  cut-off,  fj^. 

(b)  error  in  the  record  length  T. 

(c)  error  in  the  interpretation  of  the  number  of  zero  crossings, 

The  possible  error  in  the  value  of  f^^  is  the  result  of  several  factors 
including  the  determination  of  the  half  power  point  of  the  high  frequency  cut¬ 
off,  the  calculation  of  the  effective  cut-off  frequency  as  compared  to  the 
half  power  point,  and  drift  in  the  filter  characteristics.  Referring  to 
Fig.  12.  3,  the  half  power  point  is  determined  by  reading  the  frequency  from 
Item  E  when  the  filter  response  is  3  db  down  from  the  maximum  response, 
as  read  from  Item  I,  for  a  sine  wave  applied  at  a  constant  input  voltage,  as 
read  from  Item  D.  The  indirect  sources  of  error  are  then  the  lack  of  a 
perfect  frequency  response  in  the  two  voltmeters  (Items  D  and  I), 
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FREQUENCY  -  CPS 

Figure  12.  7  Narrow  Band  Shaping  Filter  Characteristics 
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the  ±  1  cps  accuracy  of  the  frequency  cou.nter  (Item  D),  and  observational 
errors.  It  is  believed  that  the  total  effect  of  these  factors  on  the  determina¬ 
tion  of  the  half  power  point  frequency  is  less  than  ±.  1%  for  these  experiments. 
The  half  power  point  is  carefully  checked  immediately  before  each  experi¬ 
ment.  Since  a  single  record  run  is  never  greater  than  about  three  seconds, 
the  effect  of  filter  drift  is  considered  negligible.  The  computation  of  the 
effective  cut-off  frequency  for  any  given  half  power  point  is  assessed  to  be 

within  ±  2%.  Thus,  the  maximum  error  in  a  value  of  f,  is  believed  to  be 

b 

less  than  ±3%. 

The  possible  error  in  the  record  length  T  is  a  function  of  the  timing 
lines  generated  by  the  galvanometer  oscillograph  (Item  L).  The  accuracy 
of  the  timing  lines  have  been  checked  by  recording  a  sine  wave  with  a 
frequency  of  1000  cps  determined  to  i  1  cps  using  Item  E.  The  results 
indicate  the  error  in  the  timing  lines  is  insignificant. 

The  possible  error  in  the  interpretation  of  the  number  of  zero  cross¬ 
ings  IS  the  result  of  two  factors.  First,  the- correct  identification  of 

the  zero  line  or  mean  value  of  the  signal,  and  second,  the  correct  identi¬ 
fication  of  a  crossing.  The  mean  value  of  the  signal  is  automatically 
rendered  zero  by  the  filtering  conditions  as  well  as  the  lack  of  DC  response 
capabilities  in  other  instruments.  By  carefully  setting  the  galvanometer  on 
the  zero  base  line  of  the  record  before  each  experiment,  the  error  in 
identifying  the  zero  line  becomes  insignificant.  However,  the  zero  line  on 
the  record,  as  well  as  the  signal  trace,  has  a  finite  width  or  thickness. 

This  introduces  the  problem  of  interpreting  a  zero  crossing  when  a  signal 
peak  occurs  near  the  zero  line.  The  following  definitions  are  employed  in 
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in  these  experiments.  Note  that  the  width  of  the  trace  is  exaggerated  for 


clarity. 


zero  line 


zero  line 


zero  line 


No  zero  crossings 


Only  one  zero  crossing 


Two  zero  crossings 


There  are  other  less  tangible  errors  associated  with  the  experiments 

that  have  not  been  mentioned.  The  most  significant  of  these  is  the  possible 

effect  of  the  filter  skirts.  As  the  bandwidth  of  the  variable  band  pass  filter 

is  made  narrower,  the  effect  of  the  skirts  on  the  over-all  filter  band  pass 

characteristics  is  increased.  In  other  words,  if  f  is  a  substantial  frac- 

a 

tion  of  fj^,  a  large  part  of  the  filter  transmission  of  a  random  signal  is 
occurring  in  the  skirts.  It  is  difficult  to  assess  the  error  that  might  be 
introduced  by  this  effect,  but  the  possibility  of  such  an  error  should  be  noted. 

Clipping  of  the  random  signal  by  the  instruments  is  another  source  of 
possible  error.  To  minimize  the  possible  effects  of  clipping,  all  experi¬ 
ments  are  conducted  with  a  signal  level  giving  a  crest  factor  of  at  least  4. 
That  is,  the  rms  voltage  of  the  signal  was  established  at  less  than  1/4 
the  voltage  level  where  clipping  would  occur  in  any  of  the  instruments. 
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12.  4  RESULTS  OF  EXPERIMENTS 
12  4  1  Zero  Crossing  Data 

The  number  of  zero  crossings  counted  in  each  of  the  31  sample  records 
gathered  for  each  experiment  are  presented  in  Tables  12. 2  and  12.3.  The  results 
of  experiments  with  a  random  signal  are  coveredin  Table  12.  2,  and  the  results 
of  experiments  with  a  nonrandom  signal  are  covered  in  Table  12.3.  The  test 
designations  refer  to  the  test  procedures  defined  in  Section  12.  2. 


Sample 

Number 

Number  of  Zero  Crossings 

For  Sample  Records  of  Length  T  Seconds 

Test  Procedure 

A-1 
T=0.  03 

A-2 
T=0.  05 

A-3 
T=0.  1 

B-1 
T=0.  1 

B-2 
T=0.  1 

B-4 
T=0.  1 

1 

65 

61 

77 

68 

74 

107 

91 

2 

68 

69 

70 

45 

75 

104 

87 

3 

59 

57 

76 

70 

71 

msm 

95 

4 

79 

60 

81 

54 

70 

107 

85 

5 

73 

61 

91 

36 

77 

101 

72 

6 

81 

78 

78 

63 

71 

108 

82 

7 

70 

68 

79 

37 

80 

108 

101 

8 

77 

67 

74 

74 

77 

110 

97 

9 

72 

59 

85 

57 

74 

106 

79 

10 

78 

64 

80 

48 

81 

108 

85 

11 

65 

63 

94 

53 

73 

105 

89 

12 

76 

55 

83 

55 

72 

109 

81 

13 

76 

68 

80 

59 

74 

105 

95 

14 

69 

65 

83 

49 

76 

107 

85 

15 

66 

62 

89 

39 

72 

107 

88 

16 

77 

62 

74 

53 

76 

110 

93 

17 

76 

71 

75 

56 

75 

107 

99 

18 

70 

60 

87 

59 

73 

109 

104 

19 

73 

62 

93 

59 

68 

110 

91 

20 

69 

62 

64 

59 

76 

107 

91 

21 

73 

55 

88 

56 

75 

108 

98 

22 

80 

60 

87 

51 

73 

109 

92 

23 

72 

68 

79 

36 

81 

108 

97 

24 

82 

64 

83 

73 

72 

110 

82 

25 

68 

60 

80 

58 

70 

107 

90 

26 

74 

68 

84 

51 

71 

106 

98 

27 

83 

66 

91 

57 

71 

101 

82 

28 

59 

66 

85 

57 

73 

103 

90 

29 

74 

55 

78 

68 

71 

105 

98 

30 

64 

55 

86 

57 

72 

109 

104 

31 

67 

59 

81 

43 

73 

105 

98 

Table  12.  2  Results  of  Experiments  with  a  Random  Signal 
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Sample 

Number 

Number  of  Zero  Crossings 

For  Sample  Records  of  Length  T  Seconds 

Test  Procedure 

|R| 

C-2 
T=0.  05 

C-3 
T=0.  05 

C-4 

T=0.05 

C-5 
T=0.  10 

H^QI 

C-7 

T=0.10 

C-8 

T=0.10 

C-9 

T=0.10 

1 

60 

62 

64 

68 

51 

76 

89 

94 

2 

65 

71 

74 

69 

55 

68 

82 

89 

94 

3 

55 

67 

68 

73 

55 

63 

80 

91 

102 

4 

60 

64 

66 

69 

58 

71 

78 

90 

95 

5 

53 

58 

76 

72 

68 

69 

75 

85 

98 

6 

61 

67 

62 

66 

48 

69 

79 

84 

103 

7 

69 

58 

67 

71 

64 

66 

79 

84 

102 

8 

61 

69 

72 

68 

61 

69 

80 

91 

99 

9 

58 

70 

58 

70 

61 

70 

76 

86 

104 

10 

59 

68 

70 

63 

48 

74 

80 

92 

108 

11 

47 

50 

64 

73 

63 

68 

75 

90 

100 

12 

54 

65 

65 

66 

58 

76 

90 

85 

105 

13 

56 

72 

62 

72 

56 

70 

82 

84 

102 

14 

57 

63 

68 

66 

58 

63 

83 

91 

105 

15 

58 

58 

63 

74 

65 

66 

78 

92 

103 

16 

56 

73 

60 

84 

60 

67 

73 

94 

106 

17 

59 

60 

70 

76 

66 

65 

77 

92 

108 

18 

48 

70 

65 

66 

56 

68 

78 

88 

104 

19 

62 

59 

70 

58 

54 

70 

77 

82 

99 

20 

61 

63 

61 

68 

68 

56 

74 

90 

105 

21 

61 

69 

65 

81 

70 

62 

77 

86 

106 

22 

43 

59 

70 

73 

60 

68 

71 

87 

100 

23 

67 

68 

70 

74 

57 

67 

75 

84 

109 

24 

57 

68 

73 

73 

58 

63 

75 

92 

102 

25 

67 

64 

71 

66 

60 

63 

80 

87 

108 

26 

63 

64 

70 

76 

62 

74 

73 

83 

102 

27 

61 

67 

78 

71 

61 

67 

81 

89 

104 

28 

65 

62 

62 

73 

56 

67 

75 

89 

107 

29 

58 

69 

60 

74 

65 

61 

73 

91 

100 

30 

62 

55 

70 

63 

71 

71 

80 

84 

109 

31 

54 

61 

66 

72 

56 

69 

78 

89 

101 

Table  12.  3  Results  of  Experiments  with  a  Nonrandom  Signal 


The  effective  low  and  high  frequency  band  pass  limits  for  the  experiments 
are  presented  in  Table  12.  4.  The  effective  cutoff  frequencies  are  determined  as 
discussed  in  Section  12.  3.  2. 
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Experiment  by 

Test  Procedure 
(Section  1  2.  2) 

Effective  Low 
Frequency  Cut-Off 

f  (cps) 

a 

Effective  High 
Frequency  Cut-Off 

fj,  (cps) 

A-1 

28.  5 

2100 

A-2 

28.  5 

1050 

A-3 

95 

630 

B- 1  through  B-4 

95 

630 

C-  1  through  C-4 

28.  5 

1050 

C-5  through  C-9 

95 

630 

Table  12.4  Effective  Frequency  Band  Pass  Limits 


12,4.2  Statistical  Estimates  from  Zero  Crossing  Data 

From  the  zero  crossing  data  presented  in  Section  1  2.  4.  1,  the  estimated 


mean  value 


A 


and  the  estimated  variance  a  of  the  sampling  distribu- 

^  o  *^o 

tion  for  each  experiment  are  determined  using  Eq8.(  1 2. 14)  and  ( 1 2. 15).  The 

estimates  are  presented  in  Table  12.  5. 


Description 

Effective 

Test 

Mean  Value 

Vari^ce 

O’ 

of 

Frequency 

Procedure 

/\ 

Experiment 

Range  (cps) 

(Section  1 2.  2) 

Vo 

random  signal  with 

28.  5  to  2100 

A-1 

72.  10 

38.  03 

an  approximately 

28.  5  to  1050 

A-2 

62.  90 

27.  00 

uniform  power 
spectrum 

95  to  630 

A-3 

81.  77 

44.  23 

B-  1 

54.  84 

99.  16 

random  signal 

95  to  630 

B-2 

73.  77 

9.  65 

with  a  non-uniform 

B-3 

106.  94 

5.  68 

power  spectrum 

B-4 

90.  94 

57.  87 

C-1 

58.  61 

32.  35 

28.  5  to  1050 

C-2 

C-3 

64.  29 

67.  10 

28.  52 
23.  58 

nonrandom  signal 

C-4 

70.  58 

26.  52 

(sine  wave  plus 

C-5 

59.  65 

32.  49 

random  noise) 

C-6 

67.  35 

16.  35 

95  to  630 

C-7 

77.  74 

13.  74 

C-8 

88.  06 

10.  38 

C-9 

102.  71 

16.  52 

Table  12.  5  Estimated  Mean  and  Variance  of  Sampling  Distribution 
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12.  4,  3  Expected  Values  for  Random  Signal  Zero  Crossings 


For  sample  records  gathered  from  a  random  signal,  the  expected 
values  of  the  mean  and  variance  of  the  sampling  distribution,  as  predicted 
by  run  theory,  are  computed  using  Eqs.  (12;  7),  (12.8),  (12.11),  and 
(12.  13).  These  expected  values  for  the  effective  frequency  bandwidths 
used  in  the  experiments  are  presented  in  Table  12.  6. 


Experiment 

by 

Test  Procedure 
(Section  1  2.  2) 

f 

a 

(cps) 

'b 

(cps) 

K 

Eq. 

(12.11) 

n 

Eq. 

(12.13) 

^^o 

Eq. 

(12.7) 

2 

Vo 

Eq. 

(12.8) 

Vo 

A-1 

A-2 

A-3 

28.  5 

28.  5 

95 

2100 

1050 

630 

2441.49 

1229.22 

788.00 

146.49 

122.92 

157.60 

73.24 

61.46 

78.80 

36.37 

30.48 

39.14 

6.  03 

5.  52 

6.  26 

B-  1  through  B-4 

same  as  A-3 

C- 1  through  C-4 

same  as  A-2 

C-5  through  C-9 

same  as  A-3 

Table  12.  6  Expected  Values  for  Mean  and  Variance  of  Zero  Crossings 


12.  4.  4  Statistical  Testing  of  Zero  Crossing  Data 

Let  the  following  null  hypotheses  be  established. 


The  above  null  hypotheses  are  now  tested  for  the  data  presented  in 

Tables  12.  5  and  12.  6,  by  the  procedures  outlined  in  Section  12.  2.  3.  The 

2 

results  for  tests  of  H^(o'  )  are  included  in  Table  12.  7,  and  the  results  for 
tests  of  H^(|Jl)  are  presented  in  Table  12.  8. 
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Experiment  by 
Test  Procedure 
(Section  1 2.  2) 


1.  046 

0.  886 

1.  130 

2.  533 
0.  246 
0.  145 
1.  478 
1.061 
0.  936 
0.  774 
0.  870 
0.  830 
0.  418 
0.  351 
0.  265 
0.  422 


Region  of  Acceptance 
For  Test  of 
from  Eq.  (12.  23) 


Result 

of 

Test 


accepted 

accepted 

accepted 

rejected 


Table  12.7  Tests  for  Equivalence  of  Variances 


Experiment  by 
Test  Procedure 

(Section  12.  2) 

■ 

Region  of  Acceptance 
For  Test  of 
from 

Eq.  (12.24)  or  (12.  25) 

Result 

of 

Test 

A-1 

-1.  14 

-1.  78  to  I.  78 

accepted 

A-2 

1.  44 

-1.  63  to  1.  63 

accepted 

A-3 

2.  97 

- 1.  85  to  1.85 

rejected 

B-1 

-23.  96 

-3.  09  to  3.  09 

rejected  * 

B-2 

-5.  03 

-0.  96  to  0.  96 

rejected  * 

B-3 

28.  14 

-0.  74  to  0.  74 

rejected  * 

B-4 

12.  14 

-2.  36  to  2.  36 

rejected  ♦ 

C-1 

-2.  85 

-  1.  63  to  1.  63 

rejected 

C-2 

2.  83 

-1.  63  to  1.  63 

rejected 

C-3 

5.  64 

-1.  63  to  1.  63 

rejected 

C-4 

9.  12 

-1.  63  to  1.  63 

rejected 

C-5 

-19.  15 

-1.  85  to  1.  85 

rejected 

C-6 

-11.  45 

-1.  25  to  1.  25 

rejected  * 

C-7 

-1.06 

-1.  15  to  1.  15 

accepted  ^ 

C-8 

9.  26 

-1.  00  to  1.  00 

rejected  * 

C-9 

23.  91 

- 1.  26  to  1.  26 

rejected  ♦ 

% 

null  hypothesis  H^(^)  tested  by  student's  "t"  test. 


Table  12.8  Tests  for  Equivalence  of  Means 
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12.  5  DISCUSSION  OF  RESULTS 

12.  5.  1  Results  for  Experiments  in  Area  A 


The  experiments  in  Area  A  deal  with  sample  records  from  a  signal 
which  is  considered  truly  random,  and  which  has  an  approximately  uniform 
power  spectrum  and  Gaussian  amplitude  probability  density  function.  Then, 
the  distribution  for  the  number  of  zero  crossings  in  a  sample  record  should 
have  a  mean  and  variance  as  theoretically  predicted  by  Eqs.(12.  7)  and 
(12.  8).  If  Eqs.  (12.  7)  and  (12.  8)  are  valid,  the  null  hypothesis  tests  should 
accept  the  estimated  sampling  mean  and  variance  for  all  data  in  Area  A 
as  being  statistically  equivalent  to  the  theoretical  values.  The  results  of 
the  null  hypothesis  tests  in  Area  A  are  summarized  in  Table  12.  9. 


Experiment 

Effective 

Results  of 

by 

Frequency 

Null  Hypothesis  Tests 

Test  Procedure 

Range 

2 

(Section  12.  2) 

(cps  ) 

Ho(o^ 

A-1 

28.  5to  2100 

accepted 

accepted 

A-2 

28.  5  to  1050 

accepted 

accepted 

A-3 

95  to  630 

accepted 

rejected 

Table  12.  9  Summary  of  Results  for  Experiments 
in  Area  A 


The  experimentally  estimated  and  theoretical  expected  sampling  variances 
are  accepted  as  equivalent  for  all  three  experiments  performed.  The 
estimated  and  expected  sampling  means  are  accepted  as  equivalent  for 
two  of  the  three  experiments,  but  rejected  for  the  experiment  where  the 
signal  frequency  range  is  95  to  630  cps. 

From  Table  12.  8,  it  is  seen  that  the  differences,  Pj  .  -  p.  .  ,  for 

Test  Procedure  A-3  is  not  far  outside  the  region  of  acceptance.  The 
rejection  could  be  a  Type  I  error  (rejection  of  the  hypothesis  when  in 
fact  it  is  true),  which  is  to  be  expected  in  one  of  every  ten  experiments 
conducted  in  Area  A.  It  could  also  be  the  result  of  a  bias  error  due  to 
the  relatively  narrow  frequency  range  for  the  experiment,  as  discussed 
in  Section  12.  3.  4.  Because  the  equivalence  of  variances  and  means  are 
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accepted  for  all  other  tests  in  Area  A,  and  in  light  of  the  above  mentioned 
possible  errors,  it  is  believed  a  strong  qualitative  argument  exists  to 
neglect  the  single  rejection  in  Table  12.  9.  Thus,  the  results  of  experi¬ 
ments  in  Area  A  are  considered  as  confirmation  of  the  validity  of 
Eqs.  (12.  7)  and  (12.  8). 

12.  5.  2  Results  for  Experiments  in  Area  B 

The  experiments  in  Area  B  deal  with  sample  records  from  a  signal 
which  is  considered  truly  random  and  has  an  approximately  Gaussian 
amplitude  probability  density  function,  but  does  not  have  a  uniform  power 
spectrum,  These  experiments  are  conducted  to  determine  if  Eqs.  (12.  7) 
and  (12.  8)  are  acceptable  approximations  for  the  sampling  distribution 
mean  and  variance  of  the  2ero  crossings  of  a  random  signal  that  does  not 
have  a  uniform  power  spectrum. 

From  Section  12.  4.  4,  it  is  seen  that  the  null  hypothesis  of  equivalence 
for  the  experimentally  estimated  and  theoretical  expected  sampling  mean 
and  variance  are  rejected  for  every  experiment  conducted.  Clearly, 

Eqs.  (12.  7)  and  (12  8)  are  not  valid  expressions  for  the  expected  sampling 
mean  and  variance  when  the  random  signal  being  sampled  does  not  have  a 
uniform  powe^"  spec*  rum. 

l2.  5.  .3  Results  for  Experiments  in  Area  C 

The  experiments  in  Area  C  deal  with  sample  records  from  a  signal 
which  IS  known  to  be  nonrandom.  The  results  of  the  null  hypothesis  tests 
are  presented  in  Table  12.  10. 

Test  Procedures  C-1  through  C-4  involve  a  sine  wave  component 
with  a  mean  square  value  equal  to  only  1/4  the  mean  square  value  of  the 
background  random  signal.  For  these  experiments,  the  estimated  sampling 
variances  are  accepted  as  equivalent  to  the  theoretical  expected  sampling 
variance  for  the  random  signal  alone.  It  appears  that  the  sine  wave  com¬ 
ponent  is  not  sufficiently  intense  here  to  significantly  influence  the  sampling 
variance.  However,  the  estimated  sampling  means  are  not  accepted  as 
equivalent  to  the  expected  sampling  mean  for  the  random  signal  alone. 
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Experiment 

by 

Test  Procedure 

Effective 
Frequency 
Range  of 

Frequency 
of  Sine 

MS(sine) 

Results  of  Null 
Hypothesis  Tests 

(Section  1 2.  2) 

Random 

Components 

Wave,  f 

0 

MS(  random) 

2 

Ho(<r  ) 

“o'**’ 

(cps) 

(cps) 

C-1 

28.5 

to 

1050 

1/4 

accepted 

rejected 

C-2 

28.5 

to 

1050 

mm 

1/4 

accepted 

rejected 

C-3 

28.5 

to 

1050 

600 

1/4 

accepted 

rejected 

C-4 

28.5 

to 

1050 

800 

1/4 

accepted 

rejected 

C-5 

95 

to 

630 

150 

1 

accepted 

rejected 

C-6 

95 

to 

630 

250 

1 

rejected 

rejected 

C-7 

95 

to 

630 

350 

1 

rejected 

accepted 

C-8 

95 

to 

630 

450 

1 

rejected 

rejected 

C-9 

95 

to 

630 

550 

1 

rejected 

rejected 

Table  12.  10  Summary  of  Results  for  Experiments  in  Area  C 


Test  Procedures  C-5  through  C-9  involve  a  sine  wave  component  with  a 
mean  square  value  equal  to  the  mean  square  value  of  the  background  random 
signal.  Here  the  sine  wave  component  is  sufficiently  intense  to  influence 
the  sampling  variance.  The  hypothesis  of  equivalent  variances  is  rejected 
in  four  of  the  five  experiments.  Likewise,  the  hypothesis  of  equivalent 
means  is  rejected  in  all  but  one  case,  Test  Procedure  C-7.  For  this 
experiment,  it  appears  the  frequency  of  the  sine  wave  (f^  =  350  cps)  is  just 
right  to  produce,  in  conjunction  with  the  random  component,  approximately 
the  same  number  of  zero  crossings  that  the  random  signal  alone  would  produce. 

12.6  CONCLUSIONS 

The  application  of  statistical  run  theory  to  the  prediction  of  sampling 
distributions  for  random  signal  zero  crossings  has  been  studied  experi¬ 
mentally.  The  results  confirm  the  validity  of  basic  theory.  The  theory 
correctly  predicts  the  sampling  mean  and  variance  for  zero  crossings  of 
signals  with  a  reasonably  uniform  power  spectrum. 

The  presence  of  a  sine  wave  in  the  random  signal  significantly  alters 
the  resulting  zero  crossings,  which  indicates  possible  applications  of  the 
run  theory  to  a  test  for  randomness.  However,  the  lack  of  a  uniform  power 
spectrum  also  alters  the  resulting  zero  crossings  from  theoretical  values. 
These  matters  are  considered  in  terms  of  a  test  for  randomness  in  Section  15. 
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13.  UNCERTAINTY  OF  POWER  SPECTRA 
(MEAN  SQUARE)  ESTIMATES 

13.  1  THEORY  OF  POWER  SPECTRAL  DENSITY  ESTIMATION 
13.  1.  1  Review  of  Mathematical  Relationships 

Consider  a  stationary  random  signal,  x(t).  Assume  the  signal 
is  sharply  band-limited  between  any  two  frequencies,  cps  and  £|^  cps, 
giving  an  ideal  bandwidth  of  B  =  (f.  -  f  )  cps.  The  mean  square  value 
of  x(t)  within  the  bandwidth  B  may  be  estimated  by 


x^(B) 


T 


(t)  dt 


(13.  1) 


where  T  is  the  record  length  (total  time  of  observation).  The  estimated 
mean  square  value  in  Eq.  (13.  1)  will  approach  the  expected  mean  square 
value  eC)^]  (true  mean  square  value  of  the  signal  which  hypothetically 
exists  over  all  time)  as  the  record  length  T  approaches  infinity.  That 


is, 


(13.  2) 


Furthermore,  if  the  mean  value  of  x(t)  is  zero  (no  DC  component  is 

present  or  the  bandwidth  B  does  not  include  zero  frequency),  the 

expected  mean  square  value  is  equal  to  the  variance  of  x(t),  denoted  by 
2 

cr^  (B).  That  is,  assuming  a  zero  mean  value  for  x(t), 

4*^(3)]=  <r^^(B)  (13.3) 

The  expected  or  true  mean  square  value  for  the  signal  x(t)  for  any 

2 

bandvddth  B  will  henceforth  be  denoted  by  (B),  as  defined  in  Eq.  (13.  3). 
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The  power  spectral  density  function  is  given  by 


G<f) 


lim 
B— 0 


0-  ^(B) 

X  ' 

B 


lim  lim 
B— 0  T-^oo 


Xg^(t)  dt 


(13.4) 


where  f  is  the  center  frequency  of  the  bandwidth  B.  The  power  spectral 
density  function  G(f)  then  defines  the  mean  square  value  (relative  power) 
of  a  signal  x(t)  between  any  two  frequency  limits,  f^  and  f2  .  as  follows. 


G(f)  df 


(13.  5) 


The  power  spectral  density  function  for  stationary  random 
signals  may  also  be  defined  by  the  Fourier  Transform  of  the  correlation 
function  (see  Ref.  [  l]>  Section  4.4.  2).  However,  the  definition  presented 
in  Eq.  (13.  4)  better  illustrates  the  physical  operations  required  to  esti¬ 
mate  power  spectra  with  analog  instruments. 

From  Eq.  (13.  4),  the  procedure  of  taking  the  limit  as  B 
approaches  zero  is  beyond  the  capabilities  of  physical  instruments  and, 
of  course,  the  record  length  T  must  always  be  finite.  However,  if  B 
IS  small,  an  estimate  for  the  power  spectral  density  at  any  frequency  f 
for  a  sample  record  length  T  is  given  by 


G(f)  = 


B 


Xg  (t)  dt 


(13.6) 


Equation  (13.  6)  defines  the  basic  operations  which  an  analog 
instrument  must  accomplish  to  estimate  the  power  spectrum  of  a  random 
signal  from  a  sample  record  of  length  T. 
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1.  Filtering  of  the  signal  by  some  narrow  frequency  window  having 

a  bandwidth  B. 

2.  Squaring  of  the  filtered  signal  amplitudes  and  integration  of  the 

squared  amplitudes  over  the  record  length  T. 

3.  Division  by  the  record  length  T. 

4.  Division  by  the  frequency  window  bandwidth  B. 

Of  course,  the  center  frequency  of  the  narrow  bandwidth  B 
would  have  to  be  variable  to  cover  the  entire  range  of  frequencies  under 
consideration.  The  actual  circuit  techniques  employed  by  analog  instru¬ 
ments  to  accomplish  the  above  functions  are  discussed  in  Ref. 

Sections  7.  3  and  7.  4. 

13.1.2  Theoretical  Evaluation  of  Estimation  Uncertainty 

The  statistical  uncertainty  associated  with  power  spectral 
density  estimates  is  developed  in  Ref.  ^  ij,  Section  4.  8.  From  those 
results,  the  uncertainty  for  a  power  spectral  density  estimate  at  any 
frequency  f  cps  for  a  filter  bandwidth  of  B  cps  and  a  record  length  of 
T  seconds  is  given  by 

E  [6(f)  -  G(f)]  ^  ^  +  —  [  G-'(f)]  ^  ( 1 


The  first  term  in  Eq.  (13.  7)  is  an  expression  of  variability  and  the  second 
term  is  an  expression  of  bias.  The  bias  term  will  clearly  be  negligible 
except  for  those  cases  where  the  slope  of  the  power  spectrum  is  changing 
rapidly  within  the  bandwidth  B.  For  most  cases,  the  estimation  un¬ 
certainty  may  be  considered  to  be  the  first  term  of  Eq.  (13.  7),  which  is 
conveniently  written  in  the  form  of  a  dimensionless  variance  as  follows. 


,2_  ‘"6(f)  I 

G^£)  BT 


(13 
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Note  that  B  is  an  ideal  frequency  window;  that  is,  a  bandwidth  with 
infinitely  sharp  cutoffs. 

The  results  of  Eq.  (13.  8)  may  be  arrived  at  by  a  procedure 
different  from  the  derivation  presented  in  Ref.  [  1  ]•  From  Ref.  [  2  j,  the 
equivalent  number  of  events  n  represented  by  a  continuous  white  noise 
signal  record  of  length  T  with  a  bandwidth  B  is  given  by 


n  =  2BT 


(13.9) 


A  power  spectral  density  estimate  is  effectively  a  mean  square  value  or 
variance  estimate.  Hence,  if  the  signal  x(t)  is  assumed  to  have  an 
approximately  Gaussian  probability  density  function,  the  sampling  distri- 

A 

bution  for  an  estimate  G(f)  will  be 

G(f)  ~  ^  (13.  10) 

(n  -  1) 

2 

where  means  "distributed  as  "  and  x  Is  a  chi-squared  distribution 

with  (n  -  1)  degrees  of  freedom.  Noting  that  all  terms  in  Eq.  (13.  10)  are 

2 

expected  or  exact  values  except  for  x  >  variance  of  G(f)  is  given  by 


'"e(f) 


Var 


G(f)x^ 

G(f) 

_(n-  1)  _ 

(n-  1) 

Var  X 


(13.  11) 


However,  the  variance  of  a  chi- squared  distribution  is  equal  to  twice  the 

2 

degrees  of  freedom,  or  Var  x  =  2(n-  1).  Then, 

2  ^  2G^f)(n,^  ^  Zchl)  ,2, 

(n  -  1 )  n  -  1 

Substituting  Eq.  (13.9)  into  Eq.  (13.  12),  and  assuming  n»^  1,  it  follows 
that 

^  —L  (13.  13) 

gV) 

which  is  the  same  result  presented  in  Eq.  (13.  8). 
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13.1.3  Application  of  Estimation  Uncertainty 

The  positive  square  root  of  Eq.  (13.  8)  or  Eq.  (13.  13)  defines 

A 

the  normalized  standard  error  of  an  estimate  G(f)  as  follows. 


t  = 


1^) 

G(f) 


(13.  14) 


The  term  «  is  simply  the  standard  deviation  of  the  estimate  expressed 
as  a  fractional  portion  of  the  power  spectral  density  being  measured. 

For  example,  assume  the  power  spectrum  of  a  signal  is  measured  by 
analyzing  a  sample  record  with  a  BT  product  of  100.  The  resulting 
estimate  G(f)  at  any  given  frequency  f  will  have  a  standard  deviation  of 
10%  of  the  true  power  spectral  density  at  that  frequency.  A  plot  of  the 
uncertainty  <  versus  the  BT  product,  as  given  by  Eq.  (13.  14),‘i8  shown 
in  Figure  13.  1 

The  uncertainty  of  6(f)  may  also  be  expressed  in  terms  of  con¬ 
fidence  intervals.  As  noted  in  Section  13.  1.2,  Eq.  (13.  10),  if  the  signal 
x(t)  has  an  approximately  Gaussian  probability  density  function,  the 
sampling  distribution  for  6(f)  at  any  frequency  f  will  be  as  follows. 


(13.15) 

G(f)  (n-1) 


Given  an  estimate  G(f)  obtained  from  a  sample  record  with  n  =  2BT 
events,  a  (1  -  a)  confidence  interval  for  the  true  power  spectral  density 
at  any  given  frequency  will  be 


(n-  l)G(f)  ^  ^  (n-l)G(f) 

2  -  V  ;  _  2 

\n  ^i-q/2 


(13.  16) 


where  ^q/2  I*'"  U  degrees  of  freedom.  See  Ref.[  l]. 

Sections  7.  3  and  7.  4  for  examples. 
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Figure 


It  should  be  noted  that  n  =  2BT  is  usually  in  practice  a  number  much 

greater  than  one.  As  a  result,  it  is  common  to  assume  n«(n-  1)  and 

2 

to  use  confidence  intervals  based  upon  x  with  n  degrees  of  freedom. 

Referring  to  Eq.  (13.  14),  the  bandwidth  B  is  assumed  to  be 
ideal  with  infinitely  sharp  cutoffs.  For  physical  applications  where  the 
narrow  bandpass  filter  does  not  have  ideal  cutoffs,  an  equivalent  ideal 
bandwidth  (the  noise  bandwidth  Bj^)  must  be  computed  from  the  actual 
filter  characteristics  as  follows. 


where  H(f)  is  the  frequency  response  function  of  the  narrow  bandpass 
filter.  Then,  for  practical  applications,  the  bandwidth  B  in  Eq.  (13.  14) 
should  be  determined  using  Eq.  (13.  17).  However,  if  the  narrow  band¬ 
pass  filter  of  the  analyzer  has  a  cutoff  of  at  least  60  db  per  octave,  B 
may  be  considered  as  the  bandwidth  between  half  power  points  with 
negligible  error.  This  is  usually  true  for  commercial  power  spectral 
density  analyzers. 

Again  referring  to  Eq.  (13.  14),  the  record  length  T  is  the  total 
length  of  the  sample  amplitude  time  history  available  for  analysis.  It 
is  assumed  that  a  power  spectral  density  estimate  for  each  filter  center 
frequency  is  obtained  by  averaging  over  the  entire  available  length  of 
data.  In  other  words,  in  Eq.  (13.  14),  the  averaging  time  and  the  record 
length  are  ideally  the  same  value,  T. 

Consider  now  the  cases  where  the  averaging  time  is  not  equal 
to  the  record  length  T.  Let  Tj  be  the  averaging  time.  If  Tj  is  less 


17) 
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than  T,  the  normalized  standard  error  e  will  be  determined  by  the 
value  of  Tj.  That  is. 

^  T  (13.  18) 

YbTj  * 

However,  if  T ^  is  greater  than  T,  the  value  for  €  is  not  reduced  below 
that  value  obtained  using  T  in  Eq.  (13.  14).  That  is, 

€  ««  -4=  T  ^  T.  (13.  19) 

VBT 

In  other  words,  there  is  only  so  much  data  available  for  analysis; 
namely,  T  seconds  of  data.  Obviously,  the  information  contained  in  the 
data  cannot  be  expanded  by  using  the  same  data  more  than  once  for  a 
desired  computation. 

In  actual  practice,  the  averaging  procedure  is  often  accom¬ 
plished  by  continuous  smoothing  of  the  squared  amplitude  signal  with  an 
RC  low  pass  filter.  For  this  case,  from  Ref.  ^  1  j,  Section  6.  1.  7,  the 
equivalent  averaging  time  T^  is  given  by 

T^  =  2K  (13.  20) 

where  K  is  the  RC  time  constant  of  the  low  pass  filter.  Equation  (13.20) 
assumes  the  signal  has  been  applied  for  three  or  four  time  constants 
before  a  reading  is  taken,  and  that  the  time  constant  K  is  relatively 
long  compared  to  the  period  of  the  lowest  frequency  of  interest.  Sub¬ 
stituting  Eq.  (13.  20)  into  Eq.  (13.  14),  the  following  result  is  obtained 
for  RC  averaging  type  instruments. 

‘  ^  (13.21) 

V  2BK 
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In  Eq.  (13.  21),  e  defines  the  normalized  standard  error  of  the  continuous 
estimate  at  any  instant  of  time.  Once  again,  «  can  never  be  less  than 
the  value  obtained  by  using  the  actual  record  length  T  in  Eq.  (13.  14). 
Hence,  if  K  is  greater  than  T/2,  the  normalized  standard  error  of  the 
continuous  estimate  at  any  instant  of  time  is  fixed  by  the  record  length 
T  and  given  by  Eq.  (13.  14). 

Additional  information  on  the  practical  considerations  of  power 
spectra  estimation  is  presented  in  Ref.  [l]<  Section  7.  4. 

13.  2  DESIGN  OF  EXPERIMENTS  AND  PROCEDURES 

13.  2.  1  General  Design  and  Procedures 

The  general  purpose  of  these  experiments  is  to  verify  the 
theoretical  expression  for  the  statistical  uncertainty  of  power  spectral 
density  estimates,  as  given  by  Eq.  (13.  8).  The  basic  procedure  is  to 
gather  a  series  of  N  number  of  statistically  independent  power  spectral 

A 

density  estimates,  G  ,  for  a  specific  set  of  measurement  parameters, 

B,  f  ,  and  T,.  A  variance  for  the  series  of  estimates  is  computed  and 
c  1 

2 

a  value  for  €  is  determined.  The  procedure  is  repeated  for  different 

2 

values  of  B,  f^,  and  T^.  The  resulting  set  of  empirical  values  for  e 
are  then  tested  for  equivalence  to  the  theoretical  expression  given  by 
Eq.  (13.8). 


>;<  /N 

The  notation  G  means  a  power  spectral,  density  estimate  at  a  specific 
center  frequency,  f^;  that  is,  6  =  G(f)  for  f  =  f^. 
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To  be  more  specific,  for  each  set  of  N  number  of  statistically 


independent  estimates  G,  a  sample  mean  and  variance  are  computed  as 
follows. 


G  = 


(13.  22a) 


2 

s 


N 


(13,  22b) 


The  expected  values  for  the  above  sample  mean  and  variance  are  the 

2 

power  spectral  density,  G,  and  the  variance  of  the  estimate,  erg  . 
That  is, 


(13.  23a) 
(  13.  23b) 


From  Eq.  (13.8),  the  uncertainty  € 


2 


is  given  by 


2 

€ 


» 


(13.  24) 


Then,  from  the  experimental  data  gathered,  an  estimate  for  the  un- 
2 

certainty  «  is  given  by 


Ak 


€ 


(13.  25) 


A  biased  expression  for  s  is  employed  here  so  that  all  statistical  pro¬ 
cedures  to  follow  will  be  consistent  with  procedures  outlined  in  Ref.  [ij. 
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13.  2.  2  Detailed  Test  Procedure 


The  random  signal  source  used  for  these  experiments  has  an 
approximately  Gaussian  probability  density  function  and  uniform  power 
spectrum  over  the  frequency  range  of  interest.  Power  spectral  density 
estimates  are  obtained  using  a  commercial  analyzer  which  integrates 
and  averages  instantaneous  squared  amplitudes  (estimates  mean  square 
values)  either  by  linear  integration  or  by  smoothing  with  a  low  pass  RC 
filter.  Power  spectra  estimates  are  gathered  using  both  techniques  for 
mean  square  level  determination.  However,  emphasis  is  placed  on  esti¬ 
mates  obtained  using  continuous  RG  averaging  because  this  is  the  more 
common  technique  followed  in  actual  practice.  For  this  case,  the  con- 
tinuously  averaged  estimate  is  recorded  to  obtain  G  versus  time. 

Specific  values  of  G  are  obtained  by  reading  values  from  the  continuous 
plot  at  equally  spaced  time  intervals.  The  time  interval  between  readings 
is  selected  to  be  at  least  4K  seconds  to  assure  the  G  values  are  statisti¬ 
cally  independent.  The  details  of  all  instruments,  test  set-up,  and 
calibrations  are  presented  in  Section  13.  3. 

A  total  of  N  =  61  statistically  independent  estimates  G  are 
gathered  for  each  of  M  =  11  different  sets  of  values  for  B,  f^i  and  T^, 
as  follows; 

A.  Averaging  accomplished  by  linear  integration. 

B  =  56  cps;  f^  =  1000  cps;  Tj  =  1.  0  seconds. 

B.  Averaging  accomplished  by  RC  filtering. 

B  =  56  cps;  f^  =  1000  cps. 

B  -  1.  K  =  0.  84  seconds  (T  ^  =  1.7  seconds) 

B-2.  K  =  0.  40  seconds  (Tj  =  0.  80  seconds) 

B-3.  K  =  0.  13  seconds  (Tj  =0.  26  seconds) 

C.  Averaging  accomplished  by  RC  filtering. 

B  =  56  cps;  K  =  0.  84  seconds  (Tj  =  1.  7  seconds) 

C- 1 .  f  =  100  cps 

c 

C-2.  f^  =  500  cps 

C-  3.  f  =  5, 000  cps 

c 

C-4.  f  =  10,000  cps 

C 
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D-  Averaging  accomplished  by  RC  filtering. 

=  1000  cps;  K  =  0.  84  seconds  (T^  =  1.7  seconds). 

D-  1 .  B  =  28  cps 
D-2.  B  =  14  cps 
D- 3.  B  =  5.  5  cps 

Note  that  experiment  B-1  provides  an  additional  case  for  the  experi¬ 
ments  in  both  C  and  D. 

The  various  values  selected  for  B  and  Tj  are  designed  to  cover 
the  normal  range  of  bandwidths  and  averaging  times  used  for  power 
spectral  density  analysis  in  actual  practice.  The  various  values  for  f^ 
are  designed  to  cover  the  frequency  range  of  predominate  acoustic  and 
vibration  response  in  modern  flight  vehicles.  The  determination  of  the 
frequency  bandwidths  and  averaging  times  employed  is  discussed  in 
Section  13.  4. 


13.  2.  3  Statistical  Hypothesis  Tests 

2 

In  order  to  confirm  the  theoretical  definition  for  «  given  by 

a2 

Eq.  (13.8),  the  eleven  experimentally  determined  values,  «  ,  are  tested 

2 

for  equivalence  to  the  theoretical  value  for  f  To  perform  a  test  for 
equivalence  it  is  necessary  to  define  a  sampling  distribution  for  the 

a2  2 

estimates,  t  From  Eq.  (13.  25),  it  is  seen  that  t  is  a  function  of  a 

2  — 

sample  variance  s  and  a  sample  mean  G,  which  are  in  turn  associated 

with  experimentally  determined  values  for  a  bandwidth  B  and  an  averaging 

time  Tj.  All  of  these  quantities  are  in  reality  random  variables. 

2 

The  sample  variance  s  has  a  distribution  associated  with  a 
chi- squared  distribution  as  follows 


where 

freedom. 


2  2 
s _  ^  X 


is  a  chi- squared  distribution  with  (N  -  1)  =  60  degrees  of 


(13.  26) 
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The  sample  mean  G  is  effectively  a  power  spectral  density  estimate  based 
upon  Nn  =  6l{2BT^)  number  of  events.  Thus,  G  has  a  sampling  distri¬ 
bution  given  by 


G 

G 


2 

X 

(61 n -  1) 


(13.  27) 


where  X  has  (6  In  -  1 )  degree  s  of  freedom.  The  parameter  s  B  and  T  , , 

2  —  .  ^ 
which  affect  s  and  G,  also  have  some  unknown  variability  associated 

A  2 

with  their  determinations.  The  true  sampling  distribution  for  €  in 

Eq.(i3.  25)  is  technically  a  function  of  all  these  variabilities. 

In  Eq.  (13.  25),  the  contribution  of  the  term  (G)^  to  the  total  variance 

of  is  less  than  20%  of  the  contribution  of  the  term  s^  to  the  total 

variance  of  ^  if  BT^*"  10,  as  is  the  case  for  all  experiments  performed 

herein.  This  relationship  is  developed  in  Section  13.  5.  3.  Furthermore, 

the  variances  for  the  values  for  B  and  T.  are  believed  to  be  negligible 

2  ^ 

compared  to  the  variance  of  s  .  Hence,  it  will  be  assumed  for  simplicity 

that  s  is  the  only  random  variable  in  the  experimental  procedure  for 
2 

estimating  <  by  Eq.  (13.  25).  The  effect  of  this  assumption  will  be 
discussed  later. 

The  distribution  of  s^  is  given  by  Eq.  ( 13.  26),  which  may  be 
written  using  the  relationships  from  Eq.  (13.  25)  as  follows. 


(13.  28) 


If  G  is  considered  the  expected  value  G,  from  Eq.  (13.  8),  the  denomina- 

2 

tor  of  Eq.  (13.  28)  is  equal  to  the  expected  value  for  the  uncertainty  « 
Then, 


2 

i 


2 

X 

61 


Let  it  be  hypothesized  that 


and  t 


2 


are  equivalent. 


(13.  29) 
That  is. 


(13.  30) 
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Let  the  null  hypothesis  Hq  in  Eq.  (  13.  30)  be  tested  at  the  a  =  5%  level 

of  significance.  From  Ref,  3  ,  for  a  =  5%  and  60  degrees  of  freedom, 
2  2  ' 

V  /T  =  83.  3  and  X .  ,,  =  40.5.  Then,  the  acceptance  region  for 

^a/2  ^l-a/2  re.  q 

will  be  bounded  by 


40.  5 
61 


0.  66  < 


—z 

£ 


1.  37 


83.  3 
61 


(13.  31) 


If  the  ratio  falls  within  the  above  limits,  Hq  is  accepted.  If  the  ratio 
falls  outside  the  above  limits,  is  rejected  and  there  is  reason  to 

.  .u  .  ''2  ,  2  ^ 

suspect  that  «  ^  e 

The  Type  I  error  (risk  of  rejecting  Hq  when  in  fact  it  is  true)  is, 
of  course,  5%.  The  Type  II  error  (risk  of  accepting  Hq  when  in  fact 
it  is  false)  is  a  function  of  the  level  of  significance  a  and  the  sample 
size  N.  The  general  procedures  for  computing  the  Type  II  error  for 
hypothesis  tests  are  developed  in  Ref.  ^  ij ,  Section  5.  1.  A  detailed 
illustration  of  the  procedures  is  given  in  Section  12.  2.  2.  These  experi¬ 
ments  are  designed  such  that  the  saunple  size  of  N  =  61  tested  at  the 
a  =  5%  level  of  significance  gives  a  Type  II  error  of  5%  for  detecting  a 
2;1  difference  between  t  ^  and  (1.4:1  difference  between  ^  and 

O- 

Consider  now  the  assumption  employed  to  arrive  at  Eq.  (13.  29); 
namely,  that  B,  T^,  and  G  are  exact  values  for  the  bandwidth,  the 
averaging  time,  and  the  power  spectral  density  being  measured.  The 

obvious  effect  of  this  assumption  is  to  reduce  the  predicted  variance 

2  2 
of  the  random  variable  "e  .  In  other  words,  the  variability  of 

is  actually  greater  than  predicted  by  Eq.  (13.  29),  and  the  region  of 

acceptance  for  a  test  of  Hq  at  the  5%  level  of  significance  is 

actually  greater  than  predicted  by  Eq.  (13.  31).  The  net  result  is 

that  the  Type  I  and  Type  II  errors  for  the  test  of  Hq  are  both  larger 

than  the  5%  value  for  which  the  experiments  are  designed.  Thus,  it 

can  only  be  said  that  the  Type  I  and  Type  II  errors  for  the  test  of  Hq 

in  Eq.  (13.  30)  are  at  least  5%. 
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13.  3 
13,  3.  1 


INSTRUMENTATION 
Instruments  and  Test  Set-Up 


The  laboratory  instruments  employed  for  these  experiments 
are  listed  in  Table  13,  1.  A  block  diagram  for  the  test  set-up  is  illus¬ 
trated  in  Figure  13.  2.  Except  for  the  random  noise  generator,  all 
instruments  are  the  property  of  the  Norair  Division  of  Northrop 
Corporation,  and  were  in  current  calibration  at  the  time  of  the  experi¬ 
ments. 

The  random  noise  generator  (Item  A)  is  used  as  the  source  of  a 
signal  which  is  considered  in  these  experiments  to  be  a  stationary 
random  signal.  The  instrument  generates  noise  with  an  approximately 
uniform  power  spectral  density  function  over  a  frequency  range  from 
less  than  100  cps  to  over  10000  cps  (the  frequency  range  of  interest  in 
these  experiments).  See  Section  14,  3  for  details. 

The  sine  wave  generator  (Item  B)  is  used  for  calibration  purposes 
as  discussed  in  Sections  13.  3  2  and  13.  3  3.  The  frequency  counter 
(Item  C)  IS  used  to  determine  the  frequency  of  the  sine  wave  calibration 
signals  with  an  accuracy  of  ±  1  cps. 

The  voltmeter  (Item  D)  is  used  to  measure  the  output  rms  voltage 
level  of  the  random  noise  generator,  or  the  sine  wave  generator,  for 
reference  purposes. 

The  power  spectral  density  analyzer  (Item  E)  is  used  to  obtain 
power  spectral  density  estimates  at  various  center  frequencies  and 
with  various  bandwidths  and  averaging  times,  as  discussed  in 
Sections  13.  3.  2  and  13.  3,  3.  The  strip  chart  recorder  (Item  F)  is 
used  to  record  power  spectral  density  time  history  samples  for  the 
signal  to  be  investigated. 
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Item 

Description 

Manufacturer 

Model 

No. 

Serial 

No.  * 

A 

Random  Noise 

Generator 

General  Radio  Co. 

1390A 

937 

B 

Audio  Oscillator 

Hewlett-Packard 

20  2D 

67117 

C 

Universal  EPUT 

and  Timer 

Berkeley  Division 

7350 

79528 

D 

True  RMS 

PR- 

Voltmeter 

B&K  Instruments 

2409R 

13147-1 

E 

Power  Spectral 

Technical  Products 

''TP-626 

Density  Analyzer 

Company 

TP-627 

NC44065 

TP-633 

^■3 

Strip  Chart 

■ 

Recorder 

Brush  Instruments 

Mark  II 

270822 

Except  for  Item  A,  the  serial  numbers  refer  to  Northrop  Corporation 

1  identification  tags. 

Table  13.  1  Instruments  Employed  for  the  Experiments 


J 


Figure  13.  2  Block  Diagram  of  Test  Set-Up 
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13.3.2  Characteristics  of  Narrow  Bandpass  Filter 

The  power  spectral  density  analyzer  (Item  E)  is  a  heterodyne 
type  instrument.  Narrow  band  filtering  is  accomplished  by  transposing 
the  input  signal  in  frequency  past  a  high  frequency  crystal  filter.  Several 
different  bandwidths  are  available.  For  these  experiments,  four  different 
filters  are  used. 

The  cutoff  characteristics  of  each  of  the  four  filter  selections 
have  been  checked  by  applying  a  sinusoidal  signal  from  Item  B  with  a 
known  frequency  read  from  Item  C.  The  cutoff  for  each  filter  has  been 
found  to  be  very  sharp,  over  60  db  per  octave  for  a  center  frequency  of 
100  cps.  The  cutoff  for  each  filter  is  a  function  of  the  deviation  in  cps 
from  the  center  frequency,  and  is  independent  of  the  value  of  the  center 
frequency.  Thus,  the  cutoff  rate  in  terms  of  db  per  octave  increases  as 
the  center  frequency  increases.  The  selectivity  of  the  filters  over  the 
center  frequencies  of  interest  is  sufficiently  sharp  to  assume  the  effective 
noise  bandwidth  of  each  filter  is  equal  to  the  bandwidth  between  the  half 
power  points.  The  half  power  point  bandwidths  have  been  determined  to 
be  56  cps,  28  cps,  14  cps,  and  5.  5  cps. 

13.  3.  3  Determination  of  Averaging  Time  Constants 

The  power  spectral  density  analyzer  (Item  E)  is  equipped  with 
a  continuously  variable  averaging  time  constant  from  0.  1  seconds  to  100 
seconds.  Only  three  different  averaging  times  are  used  in  these  experi¬ 
ments;  namely,  a  dial  indicated  time  constant  of  one  second,  0.  5  seconds, 
and  0.  1  seconds.  The  actual  value  of  the  time  constant  K  associated  with 
each  of  the  three  dial  settings  is  established  as  follows. 

Referring  to  Figure  13.  2,  a  sinusoidal  voltage  signal  from 
Item  B  is  applied  to  the  test  set-up  and  read  out  as  a  power  spectral  density 
measurement  at  Item  F.  Since  the  applied  signal  is  periodic,  there  is  no 
statistical  uncertainty  in  the  resulting  power  spectral  density  indications. 
Item  F  is  operated  with  a  high  chart  speed  (125  mm/sec)  so  that  the 
response  time  characteristics  of  the  test  set-up  are  accurately  defined. 

The  time  constant  K  is  determined  by  measuring  the  time  required  for  a 
power  spectral  density  indication  to  rise  from  zero  to  63.  4%  of  the  final 
steady  state  value  when  the  sinusoidal  signal  is  applied  instantaneously, 
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or  the  time  required  for  the  power  spectral  density  indication  to  fall 
63.  4%  from  the  steady  state  value  when  the  sinusoidal  signal  is  removed 
instantaneously.  This  is  done  at  several  different  frequencies  to  obtain 
at  least  10  measurements  of  K  for  each  dial  setting  of  interest  on  Item  E. 

Using  the  above  procedure,  the  time  constants  associated  with 
the  three  dial  settings  of  interest  have  been  determined  to  be  as  follows. 

1.  0  second  setting  -  K  =  0.  84  seconds 

0.  5  second  setting  -  K  =  0.  40  seconds 

0.  1  second  setting  -  K  =  0.  13  seconds 

The  standard  deviation  of  the  measurements  is  such  that  only  two  signifi¬ 

cant  figures  are  considered  justified. 

It  should  be  mentioned  that  the  accuracy  of  the  values  determined 
for  K  IS  a  function  of  the  accuracy  of  the  paper  speed  control  of  the 
recorder,  Item  F.  The  accuracy  of  the  recorder  paper  speed  has  been 
checked  by  directly  recording  sine  waves  of  various  frequencies  deter¬ 
mined  to  ±  1  cps  using  Item  C.  The  results  indicate  the  error  in  the 
indicated  paper  speed  to  be  insignificant. 

13.  4  RESULTS  OF  EXPERIMENTS 
13.  4.  1  Power  Spectral  Density  Data 

The  61  power  spectral  density  estimates  gathered  for  each  of 
the  11  experiments  are  presented  in  Tables  13.  2,  13.  3,  and  13.4.  The 
test  designations  refer  to  test  procedures  defined  in  Section  13.  2.  A 
picture  of  some  typical  test  data  for  power  spectral  density  estimates 
obtained  by  continuous  RC  averaging  is  shown  in  Figure  13.  3. 

13.  4.  2  Sampling  Statistics  for  Power  Spectral  Density  Estimates 

The  sample  mean  and  variance  for  the  61  power  spectral  density 
estimates  gathered  for  each  of  the  11  experiments  are  presented  in 
Table  13.  5.  The  sample  mean  and  variance  are  computed  using  Eq.  (13.  22), 
It  should  be  noted  that  no  effort  was  made  to  use  the  same  power  spectral 
density  for  the  different  experiments,  which  is  why  the  values  for  G 
vary. 
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Power  Spectral  Density  Estimates  G  for  Record  Lengths  of  T  Seconds  or  Time  Constants  of  K  Seconds 

B  =  56  cps  ;  f  =  1000  cps 
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Table  13.  3  Power  Spectral  Density  Estimates  for  Different  Center  Frequencies 


Power  Spectral  Density  Estimate  G  for  Filter  Bandwidths  of  B  cp:? 

f  =  1000  cps  ;  K  =  0.  84  seconds 
c  ^ 


Estimate 

Number 

D~1 

B=28 

D-2 

B=14 

D-3 
B=5.  5 

Estimate 

Number 

D-  1 
B=28 

D-2 

B=14 

D-3 

B  =  5.  5 

1 

4.  80 

3.  20 

4.  90 

31 

3,  23 

4.  85 

7.  50 

2 

2.  85 

4.  42 

3.  98 

32 

3.  60 

5.  53 

3.  43 

3 

3.  13 

4.  98 

4.  6.3 

33 

2.  89 

4.  60 

4.  22 

4 

3.  96 

4.  40 

4.  32 

34 

3.  42 

4.  41 

3.  53 

5 

4.  02 

4.  61 

2.  55 

35 

3.  54 

3.  95 

6.  80 

6 

3.  69 

4.  69 

2.  24 

36 

4.  50 

3.  53 

3.  44 

7 

4.  16 

5.  10 

5.  68 

37 

3.  50 

4.  08 

4.  40 

8 

3.  28 

4.  62 

3.  16 

38 

4.  40 

3.  22 

3.  32 

9 

3.  83 

4.  16 

3.  39 

39 

3.  52 

4.  80 

5.  30 

10 

3.  34 

5.  00 

4.  27 

40 

3.  48 

4.  19 

4.  98 

1 1 

4,  56 

3.  45 

3.  68 

41 

5.  39 

5.  76 

5.  26 

12 

3.  13 

5.  10 

3.  72 

42 

3,  70 

3.  42 

4.  68 

13 

3.  70 

3.  99 

4.  21 

43 

3.  01 

4  55 

6.  50 

14 

4.  67 

6.  08 

2.  35 

44 

4.  08 

4.  90 

7.  42 

15 

4.  20 

5.  81 

6.  82 

45 

3.  61 

5.  50 

7.  78 

16 

3.  79 

4.  82 

5.  97 

46 

,3.  75 

4.  30 

2.  27 

17 

4.  14 

4.  70 

7,  02 

47 

4.  34 

3.  59 

4.  21 

18 

4.  22 

5.  02 

4.  39 

48 

4.  5  2 

4.  b3 

4.  08 

19 

3.  99 

4.  60 

6,  3l 

49 

3.  13 

5.  48 

2,  93 

20 

3.  90 

4.  93 

2.  82 

50 

4.  C2 

3.  97 

3.  73 

21 

3.  78 

5.  88 

3.  15 

51 

4.  18 

3.  41 

3.  60 

22 

4.  32 

4.  67 

4.  11 

52 

4.  80 

6.  55 

5.  00 

23 

3.  60 

6.  40 

5.  80 

53 

3.  75 

5.  90 

6.  90 

24 

5.  01 

4.  32 

3.  92 

54 

4.  89 

5.  b8 

5.  70 

25 

4.  81 

4.  06 

6.  95 

55 

4.  00 

4.  94 

4.  15 

26 

3.  32 

6,  02 

5.  IZ 

56 

4.  32 

4.  52 

4.  06 

27 

4.  93 

5.  30 

7.  42 

57 

3,  10 

4.  75 

2.  75 

28 

3.  42 

5.  62 

2.  73 

58 

4.  12 

5.  03 

2.  85 

29 

3.  17 

4.  10 

3.  89 

59 

4.  48 

5.  40 

3.  34 

30 

3.  15 

3.  01 

5.  36 

60 

3.  46 

4.  92 

4.  26 

bl 

4.  19 

3.  61 

2.  80 

Table  13.  4  Power  Spectral  Density  Estimates 
for  Different  Filter  Bandwidths 
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Time  -  Seconds 


Figure  13.  3  Examples  of  Actual  Power  Spectral  Density  Data 
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_  2 
Sample  Mean  G  and  Sample  Variance 

For  Power  Spectral  Density  Estimates  G 


1 

1 

Description  of  Experiments 
(Test  Procedures) 

Sample 

Size 

N 

Sample 

Mean 

G 

Sample 

Variance 

2 

s 

Procedure  A  (Table  2) 

61 

0.  879 

0.  0117 

Procedures  B  (Table  2 

B-1 

4.  60 

0.  191 

B-2 

4.  95 

0.  460 

B-3 

3.  77 

1.  034 

Procedures  C  (Table  3) 

C-1 

4.  63 

0.  178 

C-2 

3.  93 

0.  114 

C-3 

4.  77 

0.  267 

C-4 

4.  79 

0.  262 

Procedures  D  (Table  4) 

D-1 

3.  90 

0.  346 

D-2 

4.  71 

0.  665 

D.-3 

4.  52 

2.  19 

Table  13.  5  Sample  Means  and  Variances  for 
Power  Spectral  Density  Estimates 


Statistical  Test  of  the  Null  Hypothesis 

Hq  : 

Experiment 
(Test  Procedure) 

2  1 
*  ~  BT 

.2  3_L. 

2BK 

7  2 
rs  2  S 

■  ^6^ 

■ 

Region  of 
Acceptance  for 

t'2 

0.  66:^  1-  37 

c 

A 

0.  018 

0.  015 

0.  83 

accepted 

B-1 

0.  oil 

0. 0090 

0.  82 

accepted 

B-2 

0.  022 

0.  019 

0.  86 

accepted 

B-3 

0.  068 

0.  073 

1.  1 

accepted 

C-1 

0.  011 

0.  0083 

0.  75 

accepted 

C-2 

0.  011 

0.  0074 

0.  67 

accepted 

C-3 

0.  011 

0.  012 

1.  1 

accepted 

C-4 

0.  011 

0.  011 

1.  0 

accepted 

D-1 

0.  023 

1.  0 

accepted 

D-2 

0.  043 

0.  70 

accepted 

D-3 

0.  094 

0.  107 

1.  1 

accepted 

Table  13.  6  Statistical  Tests  for  Equivalence 
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Results  of  Statistical  Tests 


2  2 

The  tests  of  the  null  hypothesis,  Hq  :  =  «  are  presented  in 

Table  13.  6.  Only  two  significant  figures  are  carried  for  the  tests 

because  the  accuracy  of  the  measurements  of  B  and  T^  do  not  justify 

2 

more  than  two  significant  figures  in  the  values  for  £  . 

The  null  hypothesis  Hg  is  accepted  for  all  11  experiments  with 

a  minimum  Type  I  and  Type  II  error  of  5%.  Thus,  there  is  no  reason  to 

2  , 

question  the  validity  of  Eq.  (13.8),  <  =  1/BT,  for  the  range  of  parameter 

values  tested. 


13.  5 


DISCUSSION  OF  RESULTS 


13.  5.  1  Variability  of  Estimates  for  £ 


In  Section  13.  2.  3,  the  experimentally  determined  values  for  £ 

2 

are  considered  to  have  a  distribution  associated  with  x  as  shown  in 

Eq.  (13.  29).  The  assumption  employed  to  arrive  at  this  conclusion  is 

2  2 

that  all  parameters  used  to  determine  the  ratio  ”£  /£  are  exact  values 
except  for  s^.  Then  the  variability  of  the  ratio  should  actually  be  greater 
than  predicted  by  a  distribution.  It  is  interesting  to  see  if  this  effect 
IS  apparent  in  the  results  presented  in  Section  13.  4.  3. 

First,  consider  the  variance  of  the  ratio  /£  predicted  by 

2 

the  X  distribution.  From  Eq.  (13.  29),  the  variance  of  the  ratio  is 
given  by 


Var 


'^Z 

£ 

,  £ 


=  Var  ^ 
61 


_  Var (x  ) 

(61)2 


where  x  has  60  degrees  of  freedom.  The  variance  of  a  x  distribution 

2 

is  two  times  the  number  of  degrees  of  freedom,  or  120  for  x  with 
60  degrees  of  freedom. 
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Then, 


^2 

Var  — 


_  120 

■  T7IT 


=  0.  0322 


(13.  32) 


2  2 

Now  consider  the  actual  variance  of  the  ratio 'c  /e  obtained  in 
the  experimental  results.  From  the  11  values  in  Table  13.  6andEq.  (13.  22), 


Var  (r)  =  -jj 


r  = 


^2 

€ 


(r.  -  r)^  =  0.  03 


(13.  33) 


Comparing  the  results  of  Eq.  (13.  33)  with  Eq.  (13.  32),  it  appears  the 
assumption  employed  to  arrive  at  Eq.  (13.  29)  is  completely  reasonable. 


13.  5.  2  Uncertainty  of  Mean  Square  Estimates 

2 

The  mean  square  value  for  a  random  signal  between  the 

frequency  limits  f  ^  and  given  by  Eq.  (13.  5)  as 

-f. 


G(f)  df 


(13.5') 


When  a  mean  square  value  is  estimated  from  a  measured  power  spectrum, 
~2 

the  estimate  x  is  given  by 


and 


(fj.f^) 


E[x^fj.f2)]  = 


-;(fi.V  = 


(13.  34) 


(13.  35) 


Here,  N  is  the  number  of  center  frequencies  required  to  cover  the  frequency 
range  {{^  -  fj)i  is  the  power  spectral  density  measured  at  the  ith  center 
frequency,  and  is  the  bandwidth  associated  with  the  ith  center  frequency. 
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Now  consider  the  uncertainty  of  the  mean  square  estimate  x.^. 
The  variance  of  a  sum  of  random  variables  is  the  sum  of  the  variances. 
That  is,  if 

X  =  y,  +  y2+  +  y„ 

then  Var  (x)  =  Var  (y^)  +  Var  (y^)  +  •  ■  •  +  Var  (y^^)'  Then  the  variance  of 
the  mean  square  estimate  in  Eq.  (13.  34)  will  be 


Var 


Var  (G.,  B.) 
1  1 


Var  (G.) 


(13.  36) 


where,  from  Eq.  (13.  8) 


Var  (G.) 


1 


B.T 


Thus 


Var 


x^f 


r 


(13.  37) 


(13.  38) 


From  Eqs.  (13.  35)  and  (13.  38),  the  normalized  variance  of  the  mean 
square  estimate  is  now  given  by 


2 

€ 


Var[  x^(f^,  f^)] 


(13.  39) 


Equation  (13.  39)  is  a  general  result  which  applies  to  arbitrary  power 

spectral  density  G-  and  arbitrary  bandwidths  B.. 

For  the  simple  case  where  a  uniform  power  spectral  density 
G.  =  G  is  measured  between  f  j  and  using  a  constant  bandwidth  filter 
B^  =  B,  Eq.  (13.  39)  becomes 

,  2  _  NG^B  _  1  1  (13.40) 

T(NGB)^ 

since  for  this  case  NB  =  (£2  ~  £j)- 
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The  results  of  Eq.  (13.  40)  illustrate  that  the  normalized  variance  for  a 
mean  square  estimate  is  exactly  the  same  as  for  a  power  spectral  density 
estimate  (as  long  as  the  power  spectrum  is  uniform  over  the  frequency 
range  being  considered).  This  result  should  not  be  surprising  since 
power  spectral  density  measurements  are  effectively  mean  square  level 
estimates  in  narrow  bandwidths. 

The  same  result  can  be  arrived  at  more  directly  by  considering  the 
case  where  B  =  ((2  -  f  j)-  From  Eqs.  ( 13.  6)  and  ( 13.  8), 


i;^(B)  =  b8 


Var  X  (B) 


=  Var8=£!s! 

BT 


From  Eq.  (13.  5), 


4 


x^B) 


=  0-  (B)  =  BG 

X 


2 

€ 


1 

BT 


13.  5.  3  Details  of  Experimental  Error  Analysis 

Any  analytic  function  of  n  variables,  f(y,,y, . y  ),  can  be  expanded  into 

^  ^  ♦  )((  • 

a  Taylor  series  about  a  particular  point,  say  y^  ,  y^.  •  •  •  '  »  a®  follows. 


. yj  =  ^<^1 


* 

yz’ 


•  y., )  +  (yi  - 


9f 

^1^  T 

9yi 


♦ 

yz 


n 


+  (y. 


8f 

-''"’iT 

'  n 


♦ 

yz 


(13.41) 

higher  order  terms. 


Neglecting  higher  order  terms  and  assuming  the  random  variables  are 

>(>>(<  )(< 

independent  with  expected  velues  at  y.  ,  y,  ,  .  .  .  ,  y  ,  respectively, 

\  L»  n 

the  variance  of  the  function  is  approximated  by 


Var  [f(yj,  y2.  *  .  .  ,  yj]  «Var(yj) 


9f 

ayi 


♦  ♦  ♦ 

yr  yz . Vn 


+  Var(y  ) 

9f 

♦  ♦ 

♦ 

n 

•••yn 

(  13.42) 
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is 


Now  consider  the  function  as  defined  in  Eq.  ( 13.  25).  The  term 
a  function  of  two  random  variables,  5  and  s  .  From  Eq.  (13.  42), 


Var  (t^)  =  Var 


2 

1 

2 

2. 

s 

=  Var  (s^) 

+  Var(G) 

-2(s  )  (G  ) 

-  (G)^. 

2 

[{G  )  J 

— *  4 

L  (G  )^  J 

2 


(13.43) 


From  Eqs.  (13.  12),  (13.  13),  (13.  26),  and  (12.  27),  and  noting  that  the 
variance  of  x  is  equal  to  twice  the  number  of  degrees  of  freedom,  the 
following  relationships  are  true 


(.2)*  =  .  ^(N-  l)G^ 

\  N  /  G  N(n  -  1) 

(G)  =  G 


Var  ( s  )  =  Var 


Var(G)  =  Var 


2  2, 

N 


Gx 


2(N  -  l)<r} 


2G 


N‘ 

2 


Nn-l/  (Nn-1) 


For  the  case  where  both  N  and  n  are  much  greater  than  unity,  the 
above  relationships  reduce  to  the  following 


,  2,*  2G'' 

( 8  )  -  and 


n 


G  ^ 


ZC‘ 

n 


(G)  =  G 

Var(8  )  «  ^ 


N 


(13.44) 


Var(G) 


Nn 
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Substituting  the  relationships  from  Eq.(13.44)  into  Eq.(13.43),  the  follow¬ 
ing  results  are  obtained. 


Var(€ 


00 

O 

1  ■ 

^  ^  2G^ 

1 

0 

2 

8 

Nn^ 

Nn 

[  „G^  J 

Nn^ 

(13.  45) 


From  Eq.  (13.  46),  the  term  (4/n)  constitutes  that  portion  of  the  variance 

A  Z 

for  €  contributed  by  G.  Clearly,  as  n  =  2BT.  becomes  larger  than  4, 

_  /V  2  ^ 

the  effect  of  G  on  the  variance  of  t  diminishes.  For  example,  if 

n  *  2BT.  =»  20,  the  variance  of  ^  ^  would  be  20%  greater  than  the  variance 

^  2 

computed  assuming  s  to  be  the  only  random  variable.  If  n»40,  the 
variance  of  would  be  only  10%  greater,  and  so  forth. 

13.  5.  4  Normality  Assumption  for  Power  Spectra  Estimates 

Throughout  this  section,  power  spectral  density  estimates  are 

assumed  to  have  a  distribution  associated  with  •  However,  as  the 

equivalent  number  of  events  n  becomes  large,  say  greater  than  60.  the 

2 

X  distribution  is  closely  approximated  by  a  normal  distribution.  Then 
for  large  n,  it  may  be  assumed  for  practical  applications  that  power 
spectral  density  (or  mean  square)  estimates  are  normally  distributed 
with  a  normalized  variance  of  €  given  in  Eq.  (13.  8).  It  is  important  to 
note  that  even  if  the  vibration  signal  x(t)  does  not  have  an  approximately 
Gaussian  probability  density  function,  the  normality  assumption  for  power 
spectra  estimates  is  still  valid  if  n  is  large. 

13.6  CONCLUSIONS 

The  theoretical  expression  for  the  uncertainty  of  power  spectra 
estimates,  as  given  by  Eq.  (13.8),  has  been  investigated  by  carefully 
designed  laboratory  experiments.  The  practical  validity  of  Eq.  (13.  8)  was 
tested  for  analyzer  bandwidths  from  5.  5  to  56  cps,  center  frequencies 
from  100  to  10000  cps,  and  averaging  times  from  0.  26  to  1.  68  seconds. 
Averaging  by  true  integration  and  by  smoothing  with  a  low  pass  RC  filter 
were  both  employed.  All  results  support  the  practical  validity  of 
Eq.  (13.  8). 
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13.  7 
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14.  UNCERTAINTY  OF  PROBABILITY  DENSITY  ESTIMATES 


14.  1  THEORY  OF  PROBABILITY  DENSITY  ESTIMATION 
14.  1.  1  Review  of  Mathematical  Relationships 

Consider  a  stationary  random  signal,  x(t).  The  probability  that 
x(t)  assumes  particular  amplitude  values  between  x  and  x+  Ax  during  a 
time  interval  of  T  seconds  may  be  estimated  by 

k 

P(x,  x+Ax)=  ly  T.  = 

where  is  the  time  spent  by  the  signal  in  the  range  (x,  x+Ax)  during  the 
ith  entry  to  the  range,  as  shown  in  Figure  14.  1.  The  term  At/T  is  the 
total  fractional  portion  of  the  time  spent  by  the  signal  in  the  range  (x,  x+Ax). 
It  should  be  noted  that  At  will  usually  be  a  function  of  the  amplitude  x. 


Figure  14.  1  Sample  Vibration  Amplitude  Time  History  Record 


From  Eq.  (14.  1),  the  estimated  probability  P  will  approach  an  exact 
probability  P  as  the  sample  record  length  T  approaches  infinity.  That  is. 


P(x,  x+Ax)=  lim.  -  (14.2) 

T— XX)  * 
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The  probability  density  function  is  given  by 


/  \  T  P{x,  x+Ax)  I  At\  ... 

p(x)  =  lim  — J - -  lim  lim  —  —  (14.3) 

Ax-*0  Ax  Ax-^  T-«kx)  T  Ax  / 


The  probability  density  function  p(x)  then  defines  the  probability  P  of 
amplitudes  occurring  between  any  two  amplitude  limits,  x^  and  X21  as 
follows. 


P(Xj'*  X 


(14.4) 


From  Eq.  (14.  3),  the  procedure  of  taking  the  limit  as  Ax  approaches 
zero  is  beyond  the  capabilities  of  physical  instruments  and,  of  course,  the 
record  length  T  must  always  be  finite.  However,  if  Ax  is  small,  an 
estimate  for  the  probability  density  at  any  amplitude  x  for  a  sample 
record  length  T  is  given  by 


P(x) 


1 

T 


At  \ 
Ax  I 


for  small  Ax 


(14.5) 


Equation  (14.  5)  defines  the  basic  operations  which  an  analog  instru¬ 
ment  must  accomplish  to  estimate  the  probability  density  function  of  a 
random  signal  from  a  sample  record  of  length  T. 

1.  Measurement  of  the  total  time.  At,  that  the  signal  ampli¬ 
tude  falls  within  a  narrow  amplitude  window.  Ax. 

2.  Division  by  the  amplitude  window.  Ax. 

3.  Division  by  the  total  observation  time  (record  length),  T. 


Of  course,  the  center  amplitude  of  the  window.  Ax,  would  have  to 
be  variable  to  cover  the  entire  range  of  amplitudes  under  consideration. 


14.  1.  2  Theoretical  Evaluation  of  Estimation  Uncertainty 

The  statistical  uncertainty  associated  with  amplitude  probability 
density  estimates  has  been  investigated  and  defined  by  two  different  pro¬ 
cedures  in  Sections  4.  9.  2  and  7.  5.  3  of  Ref.  ^  ij.  Those  discussions, 
however,  only  consider  signals  with  a  frequency  range  from  DC  to  some 
high  frequency  cutoff,  f^^.  Furthermore,  they  employ  simplifying 
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assumptions  which  produce  results  known  to  be  very  conservative.  The 
uncertainty  of  probability  density  estimates  is  now  considered  in  more 
detail  for  the  general  case  where  the  signal  is  band-limited  between  any 
two  frequencies,  f^  and  f^. 

The  uncertainty  in  a  probability  density  estimate  at  any  amplitude  x 
may  be  expressed  by  the  variance  of  the  estimate  given  by 


‘'l(x) 


(14.6) 


where  cr^  is  the  population  variance  and  n  is  the  equivalent  number  of 
events  which  the  estimate  is  based  upon.  The  definition  of  these  two 
parameters  will  now  be  discussed. 

(a)  Number  of  Events  -  Method  1: 

From  classical  sampling  theory,  Ref.  |4j,  the  number  of  events 
represented  by  a  continuous  random  signal  is  given  by  n  =  2BT  where 
B  is  an  equivalent  ideal  bandwidth  in  cps  and  T  is  the  available  record 
length  in  seconds.  To  be  more  exact,  T  represents  the  total  time  the 
signal  is  actually  observed  and  analyzed.  For  the  problem  at  hand,  T 
is  only  that  time  spent  by  the  signal  within  the  amplitude  window  Ax, 
since  the  signal  is  not  actually  observed  and  analyzed  when  the  amplitudes 
are  outside  the  window  Ax.  This  actual  analysis  time  is  given  by  At  in 
Eq.  (14.  5).  Thus,  for  analyzing  a  sample  record  of  length  T  with  an 
amplitude  window  of  width  Ax,  the  equivalent  number  of  events  becomes 


n  =  2B  At 


(14.  7) 


From  Eq.  (14.  5),  At  =  Ax^(x)T.  Substituting  At  into  Eq.  (14.  7)  gives  the 
following  result. 

n  =  2Axp(x)BT  (14.8) 


(b)  Number  of  Events  -  Method  2; 

Another  expression  for  the  equivalent  of  number  of  events  n  can 

be  arrived  at  by  a  totally  different  approach  as  follows.  For  analyzing  a 

sairple  record  of  length  T  with  an  amplitude  window  of  width  Ax,  the 

total  number  of  times  that  data  is  observed  is  equal  to  .  T  where 

(x,  x+Ax) 
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^(x  x+Ax)  number  of  crossings  per  second  of  the  amplitude  inter¬ 

val,  (x,x+Ax).  The  number  of  events  may  be  thought  of  as  the  number  of 
crossings  of  the  interval  (x,  x+Ax)  multiplied  by  the  width  Ax  of  the 
interval.  If  the  interval  width  Ax  is  small,  the  number  of  crossings  of 
the  interval  (x,  x+Aic)  is  approximately  equal  to  the  number  of  crossings 
of  the  level  x,  denoted  by  Thus, 

n  =  Axl;^T  (14.9) 

To  permit  further  simplification  of  Eq.  (  14.  9),  assume  the  signal 
being  investigated  has  an  approximately  Gaussian  amplitude  probability 
density  function  with  a  mean  value  of  zero.  For  this  case,  from  Ref.  ^  zj, 

pmVq  (14.10) 

Substituting  Eq.  (14.  10)  into  Eq.  ( 14.  9)  and  noting  that  a  measured  proba¬ 

bility  density  'p(x)  must  be  used,  the  following  result  is  obtained. 

n  =  2.  51  Ax$(x)  T  (14.11) 

Comparing  Eq.  (4.  11)  and  Eq.  (14.  8),  it  is  seen  that  the  two  different 
concepts  for  the  number  of  events  n  produce  equations  of  a  similar  form. 
However ,  Eq.(14.  11)  includes  the  zero  crossing  term  ,  while 
Eq.  (14.  8)  involves  the  frequency  bandwidth  B.  Furthermore,  even  if 
the  signal  had  a  uniform  power  spectrum  from  DC  to  a  high  frequency 
cutoff  f^  (for  this  case,  =  1.  15B),  the  constant  coefficient  would  be 
slightly  different  in  the  two  equations. 

For  the  moment,  the  number  of  events  n  will  be  considered  to  be 
a  function  of  some  indefinite  parameter  X  with  an  indefinite  coefficient 
C^  as  follows. 

n  =  Cj  Axp(x)  XT  ;  X  =  B  or  (14.  12) 
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(c)  Population  Variance 

-  2 

In  Eq.  (14.  6),  the  population  variance  o-^  may  be  thought  of  as  the 
variance  of  a  probability  density  estimate  based  upon  one  event.  That  is, 
cr^  =j^Var  p(x)  for  n  =  ij  . 

The  term  is  a  function  of  the  variability  in  crossings  of  the  ampli¬ 
tude  range  (x,  x+Ax),  as  well  as  the  variability  in  the  time  t  spent  by  the 
signal  in  the  interval  Ax  during  each  crossing.  It  does  not  appear  that 
this  variability  can  be  readily  defined  from  theoretical  considerations  alone. 

In  Ref.  [  l]  I  it  is  assumed  that  the  standard  deviation  of  the  popu¬ 
lation,  cr  ,  for  any  amplitude  x  is  approximately  equal  to  the  probability 
P  2  2. 

density  at  that  amplitude,  p(x).  Then  cr  p  (x).  However,  this  value 

2  P 

for  cr^  is  clearly  conservative  (high).  To  illustrate  this  point,  assume 

for  any  amplitude  x  that  the  single  event  probability  density  estimates 

p^(x)  which  make  up  the  population  are  symmetrically  and  uniformly 

distributed  about  the  true  probability  density  p(x).  Since  p^(x)  can  never 

be  negative,  the  limits  of  a  symmetrical  distribution  would  be  zero  and 

2  2 

2p(x).  For  this  simple  case,  <t  =  (l/3)p  (x).  Thus,  based  upon  the 

P  2 

above  qualitative  consideration,  a  is  considered  to  be  given  by 

P 


2 

cr 

P 


=  C2P^(x) 


(14.  13) 


In  summary,  substituting  Eqs.  (14.  13)  and  (14.  12)  into  Eq.  (14.  6), 
the  following  expression  is  obtained  for  the  variance  of  a  probability 
density  estimate. 


C2P^x) 
Cj  Axp(x)XT 


(14.  14) 


It  is  convenient  to  define  the  estimation  uncertainty  in  terms  of  a  normalized 
variance  €  as  follows. 


2 

c 


Axp(x)  XT 


Co=Cj/C2 


X  =  B  or 


(14.  15) 


In  Eq.  (14.  15),  the  two  coefficients,  Cj  and  are  both  indefinite 
in  value,  so  it  is  logical  to  combine  them  into  a  single  coefficient  Cq  • 
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The  determination  of  the  coefficient  as  well  as  the  correct 
parameter  represented  by  the  term  X  is  the  primary  motivation  for  the 
experimental  study  reported  herein. 


14.  1.  3  Application  of  Estimation  Uncertainty 

The  positive  square  root  of  Eq.  (14.  15)  gives  a  normalized 
standard  deviation  for  p(x),  which  is  often  called  the  normalized  standard 
error.  That  is, 

C,. 


€  = 


Ax^(x)XT 


1/2 


(14.  16) 


It  is  important  to  note  here  that  «  is  a  function  of  the  probability  density 
estimate,  p(x).  For  each  measurement  at  any  amplitude  x,  a  new 
normalized  standard  error  «  must  be  computed. 

From  sampling  theory,  as  the  number  of  events  n  used  for  an 
estimate  p(x)  becomes  large,  the  distribution  of  p(x)  for  any  given 
value  of  X  will  approach  a  normal  distribution  with  a  mean  value  of  p(x), 
regardless  of  the  distribution  of  the  population.  The  normal  approxi¬ 
mation  should  be  reasonably  sound  if  n  is,  say,  10  or  larger.  For  this 
case,  the  sampling  distribution  for  an  estimate  p(x)  may  be  considered 
to  be  normal  with  a  mean  of  p(x)  and  a  standard  deviation  of  «  p(x). 

Then,  a  (1  -  a)  confidence  interval  for  the  true  probability  density  p(x) 
at  any  amplitude  x  will  be  as  follows. 


p(x)  -  «  p(x)  z  a/2  -  ^alZ  ^ 

Here,  is  the  normal  deviate.  From  Eq.  (14.  17),  the  (1  -  a)  con¬ 

fidence  interval  limits  for  p(x)  based  on  a  measured  estimate  p(x)  are 
given  by 

p(x)  =  p(x)  ±  t  p(x)  Zj^y^  (14.18) 


By  rearranging  terms  in  Eq.  (14.  18),  the  following  result  is  obtained. 


P(x) 


^(x) 


(14.  19) 
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14.  1.  4  Frequency  Range  Considerations 

The  indefinite  parameter  X  in  Eq.  (14.  15)  is  believed  to  be 
either  the  frequency  bandwidth  B,  in  cycles  per  second,  or  the  expected 
number  of  zero  crossings  per  second  for  the  signal.  In  either  case, 
X  is  related  to  the  spectral  composition  of  the  signal.  Some  discussion 
of  both  parameters  is  warranted. 


(a)  Frequency  Bandwidth 

Referring  to  Eq.  (14.  8),  the  bandwidth  B  is  assumed  to  be  ideal  with 
infinitely  sharp  cutoffs.  An  equivalent  ideal  bandwidth  may  be  computed 
for  any  real  linear  filter  as  discussed  in  Section  13.  1.  3.  Furthermore, 
it  is  shown  in  Section  16.  1.  5  that,  for  most  practical  applications,  the 
equivalent  bandwidth  of  a  random  signal  with  a  power  spectrum  of  G(f) 
is  given  by 


B  = 


(14.  20) 


In  words,  the  equivalent  ideal  bandwidth  is  equal  to  the  mean  square  value 

of  the  signal  divided  by  the  peak  value  of  the  power  spectrum.  For  an 

arbitrary  filter  with  equivalent  ideal  cutoff  frequencies  f^  and  fj^,  the 

bandwidth  B  =  (f.  -  f  )• 

'  b  a 

(b)  Expected  Zero  Crossings  Per  Second 

The  expected  number  of  zero  crossings  per  second  is  a  function 
of  the  probability  density  function  p(x)  and  the  power  spectral  density 
function  G(f)  for  the  signal.  From  Ref.  for  a  Gaussian  probability 

density  function,  the  term  is  given  by 

%-.z 

Equation  (14.  21)  is  a  good  approximation  for  most  real  physical  response 
signals  because  a  substantial  deviation  in  p(x)  from  the  Gaussian  form  is 
required  to  produce  significant  changes  in  the  expected  number  of  zero 
crossings  . 


/. 


f  G(f)  df 


P 


G(f)  df 


(14.21) 
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Consider  the  case  where  the  power  spectrum  G(f)  is  uniform 
between  lower  and  upper  frequency  limits,  f^  and  fj^,  respectively. 
Equation  (14.  21)  reduces  to 


f  ^  +  f  f.  +  c 

a  a  b  b 


nl/2 


(14.  22) 


The  validity  of  Eq.  (14.  22)  when  applied  to  real  analog  data  is  thoroughly 
substantiated  by  experiments  reported  in  Section  12.  The  techniques 
for  computing  the  effective  cutoff  frequencies,  f^  and  f^^,  are  developed 
in  Section  1  2.  3.  2. 

Two  interesting  special  cases  for  Eq.  (14.  22)  should  be  noted. 

First,  for  a  power  spectrum  which  is  uniform  down  to  DC(f  =  0), 

3l 

Eq.  (14.  22)  becomes 

tjj  =  1.  15fj^  =  1.  15B  (14.  23) 


Second,  for  a  power  spectrum  consisting  of  a  sharp  peak  at  some  center 
frequency  f^,  Eq.  (14.22)  becomes 


i;^  =  2f^  (14.24) 

It  is  clear  from  Eq.  (14.  22)  that  for  all  cases,  B,  since  B  is  given 

by  (f^  -  y- 

14.  1.  5  Averaging  Time  Considerations 

Referring  to  Eq.  (14.  16),  the  record  length  T  is  the  total 
length  of  the  sample  amplitude  time  history  made  available  for  analysis. 

It  is  assumed  that  a  probability  density  estimate  for  each  amplitude  x 
is  obtained  by  averaging  over  the  entire  available  length  of  data.  In 
other  words,  in  Eq.  ( 14 .  16),  the  averaging  time  and  the  record  length 
are  ideally  the  same  value,  T. 

Consider  the  cases  where  the  averaging  time  is  not  equal  to  the 
record  length  T.  Let  T^  be  the  averaging  time.  The  situation  is 
exactly  as  discussed  in  Section  13.  1.  3.  If  Tj«  T,  the  normalized 
standard  error  €  will  be  determined  by  the  value  of  Tj  . 
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If  T-^Tj,  the  value  of  £  is  not  reduced  below  that  value  obtained  using 
T.  That  is, 


y  Ax$(x)  XTj 


T^*  T 


(14.  25a) 


£ 


I  ~ 

V  Axp(x)XT 


T  -c  (14.  25b) 


For  those  cases  where  averaging  is  accomplished  by  continuous 
smoothing  of  the  instantaneous  probability  density  signal  with  a  low  pass 
RC  filter,  the  equivalent  averaging  time  Tj  is  given  by 


Tj  =  2K 


(14.  26) 


where  K  is  the  RC  time  constant  of  the  low  pass  filter.  Equation 
(14.  26)  assumes  the  signal  has  been  applied  for  three  or  four  time  con¬ 
stants  before  a  reading  is  taken,  and  that  the  time  constant  K  is  relatively 
long  compared  to  the  period  of  the  lowest  frequency  of  interest.  Sub¬ 
stituting  Eq.  (14.  26)  into  Eq.  (14.  25),  the  following  result  is  obtained  for 
RC  averaging  type  instruments. 


(14.  27a) 


(14.  27b) 


In  Eq.  (14.  27),  £  defines  the  normalized  standard  error  of  the  continuous 
estimate  at  any  instant  of  time. 

Additional  information  on  the  practical  considerations  of  proba¬ 
bility  density  estimation  is  presented  in  Ref.f  l]  ,  Section  7.  5. 
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14.  2  DESIGN  OF  EXPERIMENTS  AND  PROCEDURES 
14.  2.  1  General  Design  and  Procedures 


The  general  purpose  of  these  experiments  is  to  obtain  an 
appropriate  definition  for  the  statistical  uncertainty  of  probability 
density  estimates  from  sample  records  of  stationary  random  signals. 

To  meet  this  general  goal,  the  experiments  are  designed  for  two 
specific  objectives. 

(a)  To  determine  and  verify  the  uncertainty  expression  given  in 
general  form  by  Eq.  (14.  15).  That  is,  to  establish  the  proper 
parameter  represented  by  the  term  X  and  the  appropriate 
value  for  the  coefficient  Cq» 

(b)  To  establish  that  probability  density  estimates  may  be  con¬ 
sidered  normally  distributed  about  the  true  probability  density 
for  any  amplitude  x. 

(a)  Determination  and  Verification  of  Uncertainty  Expression 

To  establish  the  specific  form  of  Eq.  (14.  15),  the  normalized 

2 

variance  «  is  experimentally  determined  by  gathering  a  series  of  N 

A  * 

number  of  estimates  p^  for  a  specific  amplitude  v  and  a  given  set  of 
measurement  parameters.  Ax,  f^,  and  Tj.  An  empirical  value  for 
the  coefficient  Cg  is  then  computed  two  ways.  One  value  is  computed 
assuming  the  parameter  X  =  B  =  (f.  -  f  ).  and  another  value  is  com- 
puted  assuming  the  parameter  X  =  as  defined  in  Eq.  (14.  22).  The 

experiment  is  repeated  for  M  different  sets  of  values  for  v,  f^,  f^^,  and 
Tj.  The  instrument  employed  to  measure  p^  has  a  fixed  amplitude 
window  width  Ax,  so  this  parameter  cannot  be  varied.  If  the  form  of 
Eq.  (14.  15)  is  valid,  the  resulting  set  of  values  for  the  coefficient  Cg 
should  be  equivalent  when  determined  using  one  of  the  two  parameters, 

B  or  |7g  . 


*The  notation  'p  means  a  probability  density  estimate  at  a  specific 
amplitude  v;  that  is,  =  ^(x)  for  x  =  v. 
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To  be  more  specific,  for  each  sample  of  N  number  of  statisti¬ 
cally  independent  estimates  a  sample  mean  and  variance  are 
computed  as  follows. 


P  = 


(14.  28a) 


2 

s 


(14.  28b) 


The  expected  values  for  the  above  sample  mean  and  variance  are  the 

2 

probability  density,  p  ,  and  the  variance  of  the  estimate,  (r^  That 

^v 

IS, 


e[p]=  p„ 

1  V|  -I, 


ca  0-^  for  large  N 


Pv 


From  Eq.  (14.  15),  the  coefficient  Cq  is  estimated  as  follows. 

2  r 


p 


Ax  p  XT  j 


(14. 29) 


(14.  30) 


Thus,  two  different  empirical  values  for  C«  are  obtained  as  follows. 


^  s  AxBTj 
^0  " - = - 


(14.  31a) 


A  _  ®  ^*^0^1 

Cq - - - 


(14.  31b) 


The  experiment  is  repeated  M  times  with  different  values  for  v,  f^, 
fj^,  and  T  j  to  obtain  M  number  of  pairs  of  empirical  values  for  Cq 


y— -  2 

A  biased  expression  for  s  is  employed  here  so  that  all  statistical  piLO- 
cedures  to  follow  will  be  consistent  with  procedures  outlined  in  Ref.  [.  ij. 


ASD  TDR  62-973 


14-11 


(b)  Verification  that  Estimates  are  Normally  Distributed 

The  general  procedure  is  to  gather  a  large  number  of  estimates, 

“p^,  for  a  specific  amplitude  v  and  a  given  set  of  measurement  parameters, 
Ax,  f^,  fj^,  and  Tj.  The  large  sample  is  then  tested  for  normality  by  a 
"chi- squared  goodness  of  fit"  test. 

14.  2.  2  Detailed  Test  Procedure 

The  random  signal  source  used  in  these  experiments  has  an  approxi¬ 
mately  Gaussian  probability  density  function  and  uniform  power  spectrum 
over  the  frequency  range  of  interest.  The  frequency  range  of  the  signal 
is  limited  either  by  a  band  pass  filter  with  variable  lower  and  upper  half 
power  cutoff  frequencies  of  respectively,  or  by  a  narrow 

band  pass  filter  with  a  sharply  defined  bandwidth  B  on  a  center  frequency 
of  f^.  The  rms  voltage  level  of  the  band-limited  signal  is  set  at  one 
volt  for  all  experiments.  Probability  density  estimates  are  obtained  using 
a  commercial  analyzer  which  has  a  fixed  amplitude  window  of  Ax  =  0.  i 
volt,  and  which  produces  a  continuous  probability  density  estimate  by 
averaging  with  an  equivalent  low  pass  RC  filter  having  several  different 
time  constant  selections  available.  The  continuously  averaged  estimate 
is  recorded  to  obtain  a  plot  of  versus  time.  Specific  values  for 
are  obtained  by  reading  values  from  the  continuous  plot  at  equally 
spaced  time  intervals. 

The  time  interval  between  readings  is  selected  to  be  at  least  4K 
seconds  to  assure  the  values  are  statistically  independent.  The 

details  of  all  instruments,  test  set-up,  and  calibrations  are  presented 
in  Section  14.  3. 


(a)  Determination  and  Verification  of  Uncertainty  Expression 


A  total  of  N  =  6 1  statistically  independent  estimates  p^  are 

gathered  for  each  of  M  =  18  different  sets  of  values  for  K,  v, 

f,  ,  ,  as  follows 

bhp 


and 


A.  Ax  =  0.  100  volts;  v  =  0  volts;  f_ 


100  cps;  fjjjjp  =  ^00  cps. 


A  -  1.  K  =  0.  515  seconds  (T^  =  1.03  seconds) 

A-2.  K  =  0.  202  seconds  (Tj  =  0.  404  seconds) 
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A-3.  K  =  0.  109  seconds  (T^  =  0.  218  seconds) 

A-4.  K  =  0.  040  seconds  (T^  =  0.  080  seconds) 

B.  Ax  =  0.  100  volts;  K  =  0.  109  seconds  (T^  =  0.  218  seconds); 

f  ,  =  100  cps;  f,  ,  =  600  cps 

ahp  ^  bhp  ^ 

B-1.  V  =  0.  50  volts 

B-2.  V  =  1.  00  volts 

B-3.  V  =  1.  50  volts 

B-4.  V  =  2.  00  volts 

B-5.  V  =  2.  50  volts 

C-  Ax  =  0.  100  vplts;  v  =  0  volts;  K  =  0.040  seconds  (Tj  =  0.080 
seconds) 


C-1. 

f  ^  =  1000 

ahp 

cps  ; 

^bhp 

2000 

cps 

C-2. 

f  ^  =  2000 

ahp 

cps  ; 

^bhp 

4000 

cps 

C-3. 

f  ^  =  4000 

ahp 

cps  ; 

^bhp 

7000 

cps 

C-4. 

f  ,  =  7000 

ahp 

cps  ; 

^bhp 

12000 

cps 

D.  Ax  =  0.  100  volts;  v  =  0  volts;  K  =  0.  515  seconds  (Tj  =  1.  03 
seconds);  B  =  56  cps. 

D- 1.  f  =  100  cps 

D-2.  =  500  cps 

D-3.  =  1000  cps 

D-4.  =  4000  cps 

D-5.  =  7000  cps 

The  relatively  short  time  constants  in  A  are  employed  to  obtain  a 
sufficient  variability  in  the  estimates  to  minimize  readout  errors.  The 
maximum  amplitude  level  in  B  is  limited  to  2.  5  volts  (2.  5  times  the  rms 
level)  because  the  probability  density  signals  at  higher  amplitudes  are  too 
small  to  be  read  out  and  interpreted  with  reasonable  accuracy  for  the 
test  set-up  used  for  these  experiments.  The  frequency  ranges  in  C  are 
selected  to  cover  the  frequency  range  of  predominate  acoustic  and 
vibration  response  in  modern  flight  vehicles.  The  narrow  frequency 
bandwidths  with  the  wide  range  of  center  frequencies  in  D  are  selected  to 
represent  a  narrow  band  vibration  response  for  a  lightly  damped 
resonant  structure. 
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(b)  Verification  that  Estimates  are  Normally  Distributed 

A  total  of  N  =  183  statistically  independent  estimates  are 
gathered  with  the  following  test  parameters. 

Ax  =  0,  100  volts 
V  =  0  volts 
K  =  0.  109  seconds 

f  ,  =  100  cps 

ahp  ^ 

f,  ,  =  600  cps 

bhp 

The  equivalent  number  of  events  for  each  estimate  is  n  9  using 
Eq.  (14.  8),  or  n»17  using  Eq.  (14.  11). 


14.  2.  3  Statistical  Hypothesis  Tests 

(a)  Determination  and  Verification  of  Uncertainty  Expression 

In  order  to  test  the  equivalence  of  the  experimentally  determined 

values  of  Cq,  it  is  necessary  to  define  the  sampling  distribution  for  Cq. 

From  Eq.  ( 14.  31),  it  is  seen  that  is  a  function  of  five  parameters, 

^  2  - 

all  of  which  are  in  reality  random  variables.  The  terms  s  and  p  are 

sample  statistics  which,  of  course,  involve  a  probable  sampling  error. 

The  parameters  Ax,  B  or  and  Tj  also  have  some  variability 

associated  with  their  determinations.  The  true  sampling  distribution  for 

Cq  is  a  function  of  all  these  variabilities.  The  determination  of  this 

sampling  distribution  would  clearly  be  a  difficult  problem. 

As  was  done  for  the  study  of  power  spectra  estimates  in  Section  13, 

it  is  assumed  here  that  the  variability  of  the  estimated  values  C/n  is 

2  ^ 

due  only  to  the  variability  of  the  term  s  .  That  is,  it  is  assumed  that 
p  =  p^  and  that  the  values  for  Ax,  B  or  and  Tj  are  exact.  The 

effect  of  this  assumption  is  discussed  later. 

The  sample  variance  s  has  a  distribution  associated  with  a  chi- 
squared  distribution  as  follows. 


(14.  32) 
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2 

where  " "  means  "distributed  as",  and  x  is  chi- squared  with 
(N  -  1)  =  60  degrees  of  freedom.  By  substituting  the  relationships  from 
Eq.  (14.  30)  into  Eq.  (14.  32),  the  following  result  is  obtained 


{<T^  /p^)(AxpXT) 


2 

X 

61 


(14.  33) 


If  all  terms  in  the  denominator  of  Eq.  ( 14.  33)  are  considered  expected 
values,  the  denominator  is  equal  to  the  expected  value  for  the  co¬ 
efficient  Cq  .  Then, 


(14.  34) 


The  problem  remaining  is  to  determine  if  the  collection  of  experi¬ 
mental  values  for  are  equivalent  to  the  same  constant  coefficient 

Cq  when  the  parameter  X  is  either  B  or^Q  .  If  the  values  Cq  are 
equivalent  for  either  case,  the  sampling  distribution  for  Cq  will  be  as 
given  in  Eq.  (14.  34),  and  will  have  an  expected  variance  as  follows. 


cr^  =  Var 
^0 


fsl 

1 

61  J 

(61 

Var  X 


(14.  35) 


The  variance  of  a  x  distribution  is  two  times  the  number  of  degrees  of 
freedom,  or  120  for  x^  with  60  degrees  of  freedom.  Then, 


=  120 


61 


=  0.  0322  C, 


(14.  36) 


Now,  if  the  M  =  18  values  for  Cq  are  not  equivalent,  the  variance 
of  the  experimental  values  will  clearly  be  greater  than  predicted  by 

Eq.  (14.  36).  Then,  the  values  can  be  tested  for  equivalence  by  comparing 

2  2 

(T^  with  the  estimated  variance  s^  ,  computed  as  follows. 

^0  ^0 


(14.  37) 
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For  both  Eqs.  (  14.  36)  and  ( 14.  37),  Cq  is  considered  to  be  the  average  of 
the  18  values  for  Cq- 

Let  it  be  hypothesized  that  all  experimental  values,  Cq.  are  equivalent. 
Then,  the  hypothesis  Hq  becomes 

:  si  =<tI  (14.38) 

If  the  hypothesis  is  true,  the  following  probability  statement  applies. 


Prob 


.  2 


L  “ 


''a 

18 


=  (1  -  Q) 


(14. 39) 


where  is  chi-squared  with  (M  -  1)  =  17  degrees  of  freedom  for  the 

a  level  of  significance.  Thus,  to  test  Hq  at  the  a  =  0.  05  level  of  signifi¬ 
cance,  the  region  of  acceptance  is 


1.  53 


(14.  40) 


If  the  variance  ratio  is  within  the  noted  limit,  Hq  is  accepted  and  the  experi- 

/\ 

mentally  computed  values,  Cq,  are  accepted  as  equivalent.  If  the  variance 
ratio  falls  outside  the  noted  limit,  Hq  is  rejected  and  there  is  reason  to 

/V 

suspect  that  the  values  for  Cq  are  not  equivalent. 

The  probability  of  a  Type  I  error  for  a  test  of  Hq  is,  of  course, 
a  =  0.  05.  The  probability  of  a  Type  II  error  is  P  =  0.  05  for  detecting  a  ratio 

of  3:1  for  the  true  variance  estimated  by  si  and  the  predicted  variance 

2  ^0 
<r^  .  The  Type  II  error  is  determined  directly  from  the  Operating 

^0  .  .  2 
Characteristic  (OC)  curve  for  a  one-sided  (upper  tail)  x  test  at  a  =  0.  05 

for  18  samples.  This  OC  curve  is  presented  in  Figure  6.  17  of  Ref.  ^3|  . 

It  should  be  noted  that  the  test  for  equivalence  may  be  applied  to  any 
group  of  estimates  Cq  individually.  For  example,  the  value  of  Cq 
obtained  for  the  experiments  of  Test  Procedure  A  may  be  tested  for  equiva¬ 
lence  to  determine  if  Cq  is  effected  by  changes  in  the  averaging  time.  Such 
individual  tests  for  equivalence  are  performed  as  required  by  the  results. 

Of  course,  a  different  Type  II  error  probability  will  be  associated  with  such 
individual  tests  using  different  sample  sizes. 
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Consider  now  the  assumption  employed  to  arrive  at  Eq.  (14.  34); 
namely,  p,  Ax,  X,  and  are  exact  values.  The  obvious  effect  of  this 
assumption  is  to  reduce  the  predicted  variance  of  the  random  variable  Cq. 
In  other  words,  the  variability  of  Cq  is  actually  greater  than  predicted 
by  Eq.  (14.  34),  and  the  region  of  acceptance  for  a  test  of  Hq  at  the  a  =  0.  05 
level  of  significance  is  actually  greater  than  predicted  by  Eq.  (14.  40).  The 
net  result  is  that  the  probability  of  making  a  Type  I  or  Type  II  error  for 
the  test  of  Hq  is  larger  than  the  a  =  P  =  0.  0  5  value.  Thus,  it  can  only  be 
said  that  the  probability  of  a  Type  I  or  Type  II  error  for  the  test  of  Hq 
in  Eq.  ( 14.  38)  is  at  least  5%. 


(b)  Verification  that  Estimates  are  Normally  Distributed 

The  183  estimates  "p^  are  tested  for  normality  by  applying  a  "chi- 
squared  goodness  of  fit"  test,  as  detailed  in  Section  5.  3.  2  of  Ref.  1 1  j .  A 
null  hypothesis  is  established  as  follows. 


Hq  :  normally 


(14.  41) 


The  183  values  of '9  are  divided  into  k  =  16  class  intervals.  The  statistic 

2 

X  is  computed  as  follows. 


2 

X  = 


(14.  42) 


where  f.  is  the  observed  frequency  in  the  ith  class  and  F.  is  the  expected 
1  .^22 
frequency  in  the  ith  class.  The  hypothesis  Hq  requires  that  x  > 

where  x^  Is  the  actual  value  of  chi-squared  for  k  -  3  =  13  degrees  of 

freedom.  The  test  of  Hq  is  performed  at  the  q=5%  level  of  significance, 

X^  =  22.  36,  so 
0.05 


X^-*  22.  36 


(14.  43) 


If  the  computed  value  x  Is  less  than  22.  36,  Hq  is  accepted  and  the 
various  values  for  p^  are  considered  normally  distributed.  If  x  is 
greater  than  22.  36,  Hq  is  rejected.  This  means  that  there  is  reason  to 
doubt  that  the  estimates  p^  are  normally  distributed. 
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The  probable  Type  I  error  is  a  =  0.05.  Because  non-normality 
can  occur  in  an  unlimited  number  of  ways,  there  is  no  definition  for  a 
meaningful  Type  II  error. 

14.  3  INSTRUMENTATION 

14.  3.  1  Instruments  and  Test  Set-Up 

The  laboratory  instruments  employed  for  the  experiments  are 
listed  in  Table  14.  1.  A  block  diagram  for  the  test  set-up  is  illustrated  in 
Figure  14.  2.  Except  for  the  random  noise  generator,  all  instruments  are 
the  property  of  the  Norair  Division  of  Northrop  Corporation,  and  were 
in  current  calibration  at  the  time  of  the  experiments. 

The  random  noise  generator  (Item  A)  is  used  as  the  source  of  a 
signal  which  is  considered  in  these  experiments  to  be  a  stationary  random 
signal.  The  instrument  generates  noise  with  an  approximately  Gaussian 
amplitude  probability  density  function  and  an  approximately  uniform 
power  spectral  density  function  over  a  frequency  range  from  less  than 
100  cps  to  over  12000  cps  (the  frequency  range  of  interest  in  these 
experiments).  The  probability  density  function  measured  for  the  noise 
generator  is  presented  in  Figure  14.  3.  The  power  spectrum  measured 
for  the  noise  generator  is  presented  in  Figure  14.  4. 

The  sine  wave  generator  (Item  B)  is  used  for  calibration  purposes 
as  discussed  in  Sections  14.  3.  3  and  14.  3.  4.  The  frequency  counter 
(Item  C)  is  used  to  determine  the  frequency  of  the  sine  wave  calibration 
signals  with  an  accuracy  of  i  I  cps.  The  voltmeter  (Item  D)  is  used  to 
measure  the  output  rms  voltage  level  of  the  random  noise  generator,  or 
the  sine  wave  generator,  for  reference  purposes. 

The  variable  band  pass  filter  (Item  E-1)  is  used  to  limit  the 
frequency  range  of  the  random  signal  for  relatively  broad  bandwidths,  as 
required  for  Test  Procedures  A,  B,  and  C  in  Section  14.  2.  2.  The  narrow 
band  pass  filter  (Item  E-2)  is  used  to  limit  the  frequency  range  of  the 
random  signal  for  relatively  narrow  bandwidths,  as  required  for  Test 
Procedure  D  in  Section  14.  2.  2.  The  characteristics  and  calibration  of 
these  filters  are  discussed  in  Section  14.  3.  2. 

The  voltage  amplifier  (Item  F)  is  used  to  increase  the  voltage  out¬ 
put  of  the  band  pass  filter  to  a  level  required  for  proper  operation  of  the 
probability  density  analyzer  (at  least  one  volt  rms).  The  voltmeter 
(Item  G)  is  used  to  measure  the  rms  voltage  level  of  the  signal  to  be 
investigated. 
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Item 


Description 


Manufacturer 


Model 

No. 


Serial 
No.  * 


A 

Random  Noise 

Generator 

General  Radio  Co. 

1390A 

937 

B 

Audio  Oscillator 

Hewlett-Packard  Co, 

20  2D 

67117 

C 

Universal  EPUT 
and  Timer 

Berkeley  Division 

7350 

79528 

D 

True  RMS 

Voltmeter 

Ballantine 
Laboratories,  Inc. 

320 

80798 

E-1 

Variable  Band 

Pass  Filter 

Krohn-Hite 

Instrument  Co. 

330A 

56860 

E-2 

Narrow  Band  Pass 
Filter 

Technical  Products  Co. 

** 

F 

Voltage  Amplifier 

Computer  Engineering 

A1-233-B 

PR3877-4 

G 

True  RMS 

Voltmeter 

B  &K 

Instruments,  Inc. 

2409R 

PR13147-1 

H 

Probability  Density 
Analyzer 

B  &K 

Instruments,  Inc. 

160 

PR  100 11-1 

I 

Strip  Chart  Recorder 

Brush  Instruments 

Mark  II 

270822 

4 

Except  for  Item  A,  the  serial  numbers  refer  to  Northrop  Corporation 
identification  tags. 

*f’his  filter  is  incorporated 
See  Section  13.  3,  Item  E. 

in  TPC  power  spectral  density  analyzer. 

Table  14.  1  Instruments  Employed  for  the  Experiments 


The  probability  density  analyzer  (Item  H)  is  used  to  obtain  proba¬ 
bility  density  estimates  at  various  amplitude  levels  and  with  various 
averaging  times,  as  discussed  in  Section  14.  3.  3.  The  strip  chart 
recorder  (Item  I)  is  used  to  record  probability  density  time  history 
samples  for  the  signal  to  be  investigated. 
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amplitude,  volts 

Figure  14.  3  Measured  Probability  Density  Function  for  Random  Noise  Generator 
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14.  3.  2  Characteristics  of  Band  Pass  Filters 


To  determine  the  value  of  B  and  ^  for  the  band-limited 
signals  being  studied,  it  is  necessary  to  compute  the  lower  and  upper 
effective  cutoff  frequencies  for  the  band  pass  filters.  The  procedure  for 
computing  f^  and  fj^  is  detailed  in  Section  12.  3.  2.  In  general,  for  a 
band  pass  filter  with  a  frequency  response  function  H(f)  which  has  a 
maximum  value  H  at  some  frequency  f  ,  the  bandwidth  B  =  (f.  -  f  ) 
where  the  effective  cutoff  frequencies  are  given  by 


f 

a 


f 


b 


df 


df 


(14.  44) 


(a)  Variable  Band  Pass  Filter,  Item  E-1 

The  variable  band  pass  filter  used  for  Test  Procedures  A,  B,  and 
C  is  the  same  type  of  filter  (Krohn-Hite  Model  330)  that  was  carefully 
calibrated  for  several  different  cutoff  frequencies  in  Section  12.  3.  2. 
The  results  there  indicate  the  effective  cutoff  frequencies  for  the  filter 
in  terms  of  the  lower  and  upper  half  power  points,  a^nd 

respectively,  may  be  considered  to  be  as  follows. 


f 

a 


0.  95f 


ahp 


1.  05f 


bhp 


(14.  45) 


To  confirm  that  Eq.  (14.  45)  is  applicable  to  the  specific  band; pas'a  filter 
employed  in  these  experiments,  the  cutoff  characteristics  of  the  filter 
have  been  carefully  determined  for  the  case  where  f^j^p  =  100  cps  and 
fbhp  =  ^00  cps.  The  results  are  presented  in  Figure  14.  5.  A  graphical 
integration  of  the  quantity  |  H(f)|^  in  Figure  14.  5  produces  approxi¬ 
mately  the  same  results  presented  in  Eq.  (14.  45). 


(b)  Narrow  Band  Pass  Filter,  Item  E-2 

The  narrow  band  filter  employed  for  Test  Procedure  D  is  the  56  cps 
bandwidth  filter  that  was  calibrated  in  Section  13.  3.  2.  The  results  there 
indicate  the  cutoff  characteristics  are  sufficiently  sharp  to  assume  the 
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100  cps 


600  cps 
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the  filter  has  an  ideal  rectangular  response  shape.  Thus,  the  effective 
cutoff  frequencies  are  f^  ±  (1/2)B.  That  is, 


f  =  f  -  28 
a  c 

T  =  f  +28 
b  c 


(14.  46) 


14.  3.  3  Probability  Density  Analyzer 

The  amplitude  window  width  Ax  and  the  averaging  time  T^  =  2K 
are  characteristics  of  the  probability  density  analyzer.  Although  the 
manufacturer  of  the  analyzer  publishes  nominal  values  for  these  parame¬ 
ters,  they  are  determined  independently  for  these  experiments  as  follows. 

(a)  Amplitude  Window  Width 

A  signal  with  a  zero  rms  level  (no  signal  at  all)  theoretically  has  a 
probability  density  function  consisting  of  a  unity  area  delta  function  at 
the  zero  amplitude  level.  That  is, 


I  1  for  X  =  0 

p(x)  =  6(x)/  (14.47) 

0  for  X  0 

The  window  width  Ax  for  the  analyzer  is  readily  established  by 
moving  the  window  in  amplitude  through  the  zero  level  with  no  signal 
applied  to  the  analyzer.  When  the  zero  level  is  included  inside  the 
window  Ax,  the  probability  density  meter  indication  is  pegged  at  full 
scale.  When  the  zero  level  is  not  included  inside  the  window  Ax,  the 
probability  density  meter  indication  is  zero.  By  this  procedure,  the 
window  width  Ax  has  been  established  to  be  0.  100  volts  limited  by  the 
probable  errors  in  the  calibration  and  reading  of  the  amplitude  level 
scale.  These  errors  are  estimated  to  be  less  than  +5%  of  Ax. 

(b)  Averaging  Time  Constants 

The  probability  density  analyzer  is  equipped  with  seven  different 
averaging  time  constant  selections  which  are  identified  as  A  through  G 
on  a  selector  dial.  Only  four  of  the  selections  (C,  D,  E,  and  F)  are  used 
in  these  experiments.  The  value  for  the  time  constant  K  associated  with 
each  of  the  four  averaging  time  selections  is  established  by  the  following 
procedure. 
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Referring  to  Figure  14.  2,  a  sinusoidal  voltage  signal  from  Item  B 
is  applied  to  the  test  set-up  and  read  out  as  a  probability  density 
measurement  at  Item  I.  Since  the  applied  signal  is  periodici  there  is 
no  statistical  uncertainty  in  the  resulting  probability  density  indications. 
Item  I  is  operated  with  a  high  chart  speed  (125  mm/sec)  so  that  the  re¬ 
sponse  time  characteristics  of  the  test  set-up  are  accurately  defined. 
The  time  constant  K  is  determined  by  measuring  the  time  required  for 
a  probability  density  indication  to  rise  from  zero  to  63.  4%  of  the  final 
steady  state  value  when  the  sinusoidal  signal  is  applied  instantaneously, 
or  the  time  required  for  the  probability  density  indication  to  fall  63.  4% 
from  the  steady  state  value  when  the  sinusoidal  signal  is  removed 
instantaneously.  This  is  done  at  several  different  frequencies  to  obtain 
at  least  10  measurements  of  K  for  each  selector  setting  of  interest  on 
Item  H. 

Using  the  above  procedure,  the  time  constants  associated  with 
the  selector  settings  C,  D,  E,  and  F  have  been  determined  to  be  as 
follows. 

C.  K  =  0.  515  i  0.  009  seconds 

D.  K  =  0.  202  i  0.  007  seconds 

E.  K  =  0.  109  ±  0.  003  seconds 

F.  K  =  0.  040  ±  0.  0014  seconds 

The  tolerance  figures  shown  for  each  value  of  K  are  the  standard 
deviations  of  the  measurements. 

It  should  be  mentioned  that  the  accuracy  of  the  values  determined 
for  K  is  a  function  of  the  accuracy  of  the  paper  speed  control  of  the 
recorder,  Item  I.  The  accuracy  of  the  recorder  paper  speed  has  been 
checked  by  directly  recording  sine  waves  of  various  frequencies 
determined  to  ±  1  cps  using  Item  C-  The  results  indicate  the  error  in 
the  indicated  paper  speed  to  be  insignificant. 
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14.  3.  4  Other  Instrument  Evaluations  and  Calibration  Errors 


There  are,  of  course,  numerous  possible  errors  associated 
with  the  calibrations  of  all  the  instruments  employed  for  the  experi¬ 
ments.  However,  most  of  these  calibration  errors  are  not  really 
significant  in  terms  of  the  end  data  being  sought;  namely,  probability 

density  estimates  ft  as  a  function  of  Ax,  K,  v,  f  ,  and  f,  .  The  deter- 

V  a  b 

minations  and  accuracies  of  Ax  and  K  are  discussed  in  Section  14.  3.  3. 
The  value  of  v  does  not  enter  into  Eq.  {14.  30),  so  its  accuracy  is  of  no 
direct  importance. 

For  the  case  of  the  variable  band  pass  filter  (Item  E-1),  the 

possible  error  in  the  values  for  f  and  f,  is  the  result  of  several 

a  b 

factors  including  the  determination  of  the  half  power  points  of  the  filter, 
the  calculation  of  the  effective  cutoff  frequencies  as  compared  to  the 
half  power  points,  and  drift  in  the  filter  characteristics.  Referring  to 
Figure  14.  2,  the  half  power  points  for  Item  E-1  are  determined  by 
reading  the  frequency  from  Item  C  when  the  filter  response  is  3  db 
down  from  the  maximum  response,  as  read  from  Item  G,  for  a  sine 
wave  applied  at  a  constant  input  voltage,  as  read  from  Item  D.  The 
indirect  sources  of  error  are  then  the  lack  of  a  perfect  frequency 
response  in  the  two  voltmeters  (Items  D  and  G),  the  i  1  cps  accuracy 
of  the  frequency  counter  (Item  C),  and  observational  errors.  It  is 
believed  that  the  total  effect  of  these  factors  on  the  determination  of  the 
half  power  point  frequencies  is  less  than  ±  1%  lor  these  experiments. 

The  half  power  points  are  carefully  checked  immediately  before  each 
experiment.  Since  a  single  record  run  is  never  greater  than  two 
minutes,  the  effect  of  filter  drift  is  considered  negligible.  The  compu¬ 
tation  of  f^  and  fj^  for  any  given  half  power  points  is  assessed  to  be 
within  ±  2%.  Thus,  the  maximum  error  in  the  values  f  and  f,  is 
believed  to  be  less  than  ±  3%. 

For  the  case  of  the  narrow  band  pass  filter  (Item  E-2),  it  is 
believed  that  the  determination  of  the  bandwidth  B  =  56  cps  is  accurate 
to  i  2%  based  upon  repeated  measurements. 

The  possible  error  in  the  determination  of  p^  involves  a  number 
of  factors  including  sensitivity  drift  in  any  or  all  instruments  in  the 
test  set-up,  the  calibration  accuracy  of  the  probability  density  analyzer 
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(Item  H),  the  error  in  establishing  the  desired  rms  level  for  the  input 
random  signal,  and  observational  errors.  Drift  is  minimized  by  per¬ 
mitting  the  instruments  to  warm  up  for  several  hours  before  performing 
an  experiment,  and  by  checking  all  pertinent  calibrations  before  each 
individual  record  run.  The  probability  density  analyzer  is  calibrated 
prior  to  each  experiment  by  the  various  devices  incorporated  in  the 
instrument.  The  calibration  is  checked  by  applying  a  sine  wave  from 
Item  B  and  comparing  the  analyzer  probability  density  indications  with 
the  theoretically  probability  density  function  for  a  sine  wave.  The 
random  signal  is  then  applied  with  the  same  rms  level  as  the  calibrating 
sine  wave.  The  rms  level  of  the  signal  is  established  using  Item  G. 
There  are  uncertainty  fluctuations  in  the  reading  of  Item  G,  and  some 
mental  averaging  of  these  fluctuations  is  required  to  adjust  the  input 
voltage  to  the  desired  level.  The  readout  observational  errors  are 
indicated  by  the  number  of  significant  figures  recorded  for  the  values 
of  p^.  The  last  figure  in  the  p^  values  in  Section  14.  4  is  an  estimate. 
Based  upon  all  these  considerations,  the  accuracy  of  the  values  for  p^ 
are  believed  to  be  approximately  ±5%. 
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14,  4  RESULTS  OF  EXPERIMENTS 
14,  4.  1  Probability  Density  Data 

The  61  probability  density  estimates  gathered  for  each  of 
the  18  experiments  designed  to  determine  and  verify  the  uncertainty 
expression,  Eq,  (14,  15),  are  presented  in  Tables  14,  2  through  14.  5. 

The  test  designations  refer  to  test  procedures  defined  in  Section  14.  2. 
The  183  probability  density  estimates  gathered  for  the  normality 
test  are  presented  in  Table  14.  6.  The  first  6  1  of  these  values  are  the 
same  data  as  given  under  A-3  in  Table  14,  2. 

A  picture  of  some  typical  test  data  is  shown  in  Figure  14.  6, 

14.  4.  2  Frequency  Bandwidth  and  Zero  Crossing  Data 

The  effective  low  and  high  frequency  band  pass  limits, 
the  equivalent  ideal  frequency  bandwidth  and  the  expected  number  of 
zero  crossings  per  second  associated  with  the  frequency  limits  are 
presented  in  Table  14.  7.  The  effective  cutoff  frequencies  are  deter¬ 
mined  as  discussed  in  Section  14.  3.  2.  The  expected  number  of  zero 
crossings  per  second  are  determined  using  Eq.  (14.  22). 

14.  4.  3  Sampling  Statistics  for  Probability  Density  Estimates 
The  sample  mean  and  variance  for  the  6l  probability 
density  estimates  gathered  for  each  of  the  18  experiments  are  presented 
in  Table  14.  8.  The  sample  mean  and  variance  are  computed  using 
Eq.  (14.  28). 
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probability  Density  Estimates  p  for  Time  Constants  of  K  Seconds 
rms  level  =  1.  00  volt;  Ax  =  0.  100  volts;  v  =  0  volts;  ~  cps;  -  ^00  cps 
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Table  14.  2  Probability  Density  Estimates  for  Different  Averaging  Time 
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Table  14.3  Probability  Density  Estimates  for  Different  Amplitude  Levels 
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Table  14.  5  Probability  Density  Estimates  for  Different  Center  Frequencies 


Probability  Density  Estimates  p 
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f  =  100  cps  ;  ,  =  600  cps 
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Coatinuous  Probability  Density  Estimate  p  for  Various  Time  Constants  K 


rms  =  1.  00  volts:  Ax  =  0.  1  volt;  v  =  0  volts 


Time  -  Seconds 


Time  -  Seconds 


Time  -  Seconds 


Time  -  Seconds 

Figure  14.  6  Examples  of  Actual  Probability  Density  Data 
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Table  14.  7  Effective  Bandwidths  and  Expected  Zero  Crossings 


—  2 
Sample  Mean  p  and  Sample  Variance  s 

for  Probability  Density  Estimates  p^ 


Description  of  Experiment 
(Test  Procedures) 

Sample 

Size 

N 

Sample 

Mean 

P 

Sample 

Variance 

2 

s 

Procedures  A  (Table  14.2) 

A-1 

61 

0.  3939 

0.  000318 

A-2 

0.  3928 

0.  000665 

A-3 

0. 3932 

0.  00187 

A-4 

0. 4020 

0.  00537 

Procedures  B  (Table  14.3) 

B-1 

0. 3356 

0.  00116 

B-2 

0.  2300 

0.  000764 

B-3 

0.  1201 

0.  000403 

B-4 

0.  0463 

0.  000217 

B-5 

0. 0141 

0.  0000778 

Procedures  C  (Table  14.4) 

C-1 

0. 3979 

0.  000897 

C-2 

0.  4023 

0.  000490 

C-3 

0.  4023 

0.  000311 

C-4 

0. 3963 

0.  000179 

Procedures  D  (Table  14.5) 

D-1 

0. 3865 

0.  00259 

D-2 

0. 4132 

0. 00139 

D-3 

0. 4035 

0.  00185 

D-4 

1 

r 

0. 4100 

0. 00119 

D-5 

0. 4056 

0. 00268 

Table  14.  8  Sample  Means  and  Variances  for 
Probability  Density  Estimates 


ASD  TDR  62-973 


14-37 


14.  4.  4  Experimental  Values  for  the  Coefficient  and  Test  for 
Equivalence 

The  experimentally  determined  values  for  the  coefficient 
Cq  in  Eq.  (14.  15)  are  presented  in  Table  14.9.  An  estimate  0^  is 
computed  for  each  experiment  assuming  the  parameter  X  =  B  and 
x  =  I7o- 


(a)  Equivalence  of  Coefficients  Based  on  Bandwidth 

From  Table  14.  9,  the  values  for  Cq  based  on  the  bandwidth  B 
are  now  tested  for  equivalence  by  the  procedures  detailed  in  Section 
14.  2.  3(a).  Using  Eqs.  ( 14.  36)  and  ( 14.  37) 

si  =  0.000203  ai  =  0.0000426 
^0  ^0 


The  hypothesis  Hq  in  Eq.  { 14.  38)  is  tested  using  Eq.  ( 14.  40)  as 
follows. 

2 

®C 

'^0 

- —  =  4.  76  +  1.  53 

2 

^0 

Thus,  the  hypothesis  of  equivalence  is  rejected  at  the  a  =  0.  05  level 
of  significance,  and  there  is  reason  to  believe  that  the  uncertainty 
expression  given  by  Eq.  (14.  15)  with  X  =  B  is  not  valid. 


(b)  Equivalence  of  Coefficients  Based  on  Zero  Crossings 


Again  referring  to  Table  14.  9,  consider  now  the  values  for  Cq 
based  upon  the  zero  crossings  .  By  observation,  it  is  obvious 
that  the  values  for  0q  are  not  equivalent  for  those  cases  where  the 
bandwidth  is  narrow  as  represented  by  the  data  for  Test  Procedure  D. 

However,  consider  the  values  for  excluding  Test  Procedure  D; 

A  ^ 

that  is,  the  values  for  Cq  determined  by  Test  Procedures  A,  B,  and  C 
only.  These  13  values  are  now  tested  for  equivalence  by  the  procedures 
detailed  in  Section  14.  2.  3(a). 

For  the  case  of  M  =  13,  the  region  of  acceptance  for  the  hypothesis 
Hq  is  as  follows. 


2 


1.  62 


(14.  48) 
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Experimental  Values  for  the  Coefficient  Cq 
Based  Upon  the  Number  of  Zero  Crossings  per  Second 
and  Based  Upon  the  Frequency  Bandwidth  B 
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Table  14.9  Experimental  Values  for  the  Coefficient  C 


Using  Eqs.  (14.  36)  and  (14.  37), 


0. 000 156  and 


0. 000152 


The  hypothesis  Hq 
follows. 


in  Eq.  ( 14.  38)  is  tested  using  Eq.  ( 14.  48)  as 


1.03  <  1,  62 


Thus,  the  hypothesis  of  equivalence  is  accepted  at  the  a  =  0.  05  level 
of  significance,  and  the  uncertainty  expression  given  by  Eq.  (14.  15)  for 
X  =  is  considered  valid  for  the  conditions  of  Test  Procedures 
A,  B,  and  C. 


(c)  Detailed  Evaluation  of  Coefficients  Based  on  Bandwidth 

It  is  apparent  from  practical  considerations  that  the  values  for 
Cq  obtained  under  Test  Procedure  D  are  equivalent  when  based  upon 
bandwidth.  The  only  parameter  being  changed  in  Procedure  D  is  the 
center  frequency  of  a  constant  bandwidth  filter  which  changes  only 
the  expected  number  of  zero  crossings.  It  is  clear  from  observation 
that  the  values  for  Cq  based  on  zero  crossings  are  greatly  affected 
while  the  values  based  on  bandwidth  show  only  scatter  with  no  distinct 
trend.  The  scatter  is  large  because  of  practical  difficulties  encountered 
in  the  experiments  with  narrow  bandwidth  signals.  The  sampling  errors 
for  the  data  gathered  by  Test  Procedure  D  are  undoubtedly  greater 
than  theoretically  predicted  by  Eq.  (14.  34).  It  is  then  desirable  to  test 

/N 

the  equivalence  of  the  values  for  Cq  based  on  bandwidth  for  Test 
Procedures  A,  B,  and  C  alone,  as  was  done  in  (b)  for  the  data  based  on 
zero  crossings. 

For  the  case  of  M  =  13,  the  region  of  acceptance  for  the  hypothe- 
of  equivalence,  Hq,  is  as  given  in  Eq.  ( 14.  48).  Using  Eqs.  ( 14.  36)  and 
(14.  37), 

si  =  0.000209  and  cri  =  0.0000509 
'^O  '^O 
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The  hypothesis  Hq  in  Eq.  (14.  38)  is  tested  using  Eq.  (14.  48)  as  follows. 


=  4.  1 1  + 


1.  62 


Thus,  the  hypothesis  of  equivalence  based  on  X  =  B  is  rejected  at  the 
Q  =  0.  05  level  of  significance.  This  result  augments  the  conclusion 
arrived  at  in  (b)  of  this  section;  namely,  the  uncertainty  expression  given 
by  Eq.  (14.  15)  for  X  ~Vq  appropr  iate  for  the  conditions  of  Test 
Procedures  A,  B,  and  C. 

In  summary,  it  appears  that  Eq.  (14.  15)  with  X  =  ^  is  a  valid 
expression  for  the  normalized  variance  of  probability  density  estimates 
as  long  as  the  signal  bandwidth  B  is  relatively  bread.  On  the  other  hand, 
for  narrow  bandwidths,  Eq.  (14.  15)  with  X  =  B  appears  to  be  appropriate. 
These  matters  are  considered  in  more  detail  i.n  Section  14.  5. 


14.  4.  5  Test  of  Normality  for  Pi obabihiy  Density  Estimates 

The  183  probability  density  estimates  presented  in  Table  14.  6 
are  now  tested  for  normality  by  a  "chi -scu;j,.red  goodness  of  fit  test" 
using  16  class  intervals.  A  histogram  for  the  data,  is  shown  in  Figure 
14.  7.  The  computation  of  x  is  presented  in  Table  14.  10.  Note  that 
each  estimate  is  based  upon  a  number  of  events  n  se  9  using  Eq.  (14.  8) 
or  n  R5  17  using  Eq.  ( 14.  1 1). 

Let  it  be  hypothesized  that  the  estimates  are  normally  distri¬ 
buted.  From  Eq.  (14.  43).  this  hypothesis  will  be  accepted  at  the  a  =  5% 
level  of  significance  if 

X  ^  ^2. ib 


From  Table  14.  10, 

X^  =  19.85  «  22.  36 

so  the  hypothesis  is  accepted.  On  statistical  grounds,  it  is  concluded 
that  there  is  no  reason  to  suspect  that  differences  between  the  distribution 
of  and  a  normal  distribution  are  significant. 
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Figure  14.  7  Frequency  Histogram  for 

Probability  Density  Estimates 
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Table  14.10  Computations  for  Chi-Squared  Goodness  of  Fit  Test 


14.  5  DISCUSSION  OF  RESULTS 

14.  5.  1  Evaluation  of  Estimation  Uncertainty 


From  the  results  presented  in  Section  14.  4.  4,  it  appears  that  the 
normalized  variance  for  probability  density  estimates  is  not  a  simple 
function  of  only  zero  crossings  or  frequency  bandwidth  for  all  cases.  For 
those  cases  where  the  signal  bandwidth  is  relatively  wide,  Eq.  (14.  15) 
with  X  =  Uq  seems  to  be  the  best  mathematical  model  for  the  normalized 
variance  of  probability  density  estimates.  By  averaging  the  13  values  for 
under  Test  Procedures  A,  B.  and  C  in  Table  14.  9.  the  normalized 
variance  and  standard  error  for  this  case  are 

2  0.068 

Ax^»(x)^  T^ 

-  0.  26 

VAx  p{x)PqTj 

On  the  other  hand,  for  those  cases  where  the  signal  bandwidth  is  relatively 
narrow,  Eq.  (14.  15)  with  X  =  B  is  the  best  model  for  the  normalized 
variance  of  probability  density  estimates.  By  averaging  the  five  values 
for  Cq  under  Test  Procedure  D  in  Table  14.  9,  the  normalized  variance 
and  standard  error  for  this  case  are 

2  0.028 

€  =  - 

Ax^(x)BTj 

€  0.  17 

V  Ax^(x)BTj 

The  question  that  arises  is  when  does  Eq.  (14.  50)  apply  instead  of 
Eq.  (14.  49).  The  data  gathered  is  not  sufficient  to  firmly  answer  this 
question.  However,  based  upon  the  data  available,  it  appears  that  the 
critical  relationship  is  the  ratio  of  bandwidth  to  expected  zero  crossings. 
When  this  ratio  is  very  small,  as  occurs  for  narrow  bandwidths  on  high 
center  frequencies,  Eq.  (14.  50)  applies.  For  the  case  where  the  band¬ 
width  to  zero  crossing  ratio  is,  say,  greater  than  one-third,  Eq.  (14.  49) 
applies.  Thus,  it  is  believed  that  Eq.  (14.  49)  applies  to  low  frequency 


(14.  50a) 

(14.  50b) 


(14.  49a) 

(14.49b) 
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signals  where  the  bandwidth  is  narrow  but  the  expected  number  of  zero 
crossings  is  also  small. 

It  appears  that  the  theoretical  developments  for  the  estimation  un¬ 
certainty  in  Section  14.  1.  2  are  not  yet  m  final  complete  form.  The  experi¬ 
mental  results  in  Section  14.  4.  4  tend  to  indicate  the  true  normalized 
variance  for  probability  density  estimates  is  a  complicated  function  of  both, 
the  expected  number  of  zero  crossings  and  the  frequency  bandwidth  of  the 
signal  being  investigated.  However,  it  is  also  possible  that  the  specific 
probability  density  analyzer  employed  for  these  experiments  does  not 
functionally  produce  estimates  in  rigorous  compliance  with  the  mathematical 
models  developed  in  Section  14.  1.  1.  These  possibilities  are  left  unresolved. 

It  IS  interesting  to  consider  possible  mathem.aticai  formul.as  for  the 
uncertainty  of  probability  density  estimates  which  produce  a  reasonable 
fit  to  the  data  gathered  in  these  experiments.  By  inspection  and  trial  and 
error,  the  following  equation  for  the  normalized  variance  of  estimates 
is  presented  without  theoretical  justification.  Other  equations  might  be 
equally  applicable.  Assume 


Ax^{x)  b[i  -(B/^ypl^jT^ 


(14.  51) 


Using  the  data  presented  in  Table  14.  9,  the  values  for  Cq  resulting  from 
the  formula  presented  in  Eq.  (14.  51)  are  computed  as  shown  in  Table  4.  11. 

From  the  data  in  Table.  14.  11,  it  is  seen  that  the  resulting  values 
for  are,  in  qualitative  terms,  reasonably  equivalent.  By  averaging 

the  18  values  for  Cq  in  Table  14.  11,  the  normalized  variance  and  standard 
error  for  this  case  are 


2  _  _ 0.  025  _ 

Ax^(x)b[i  -(B/Pq)^]  Tj 

_ 0.  16 _ 

Vax0(x)b[i  -(B/i7Q)'^]Tj 


(14.  51a) 


(14.  51b) 
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Experimental  Values  for  the  Coefficient  Cq 


Based  Upon  the  Assumed  Formula  of  Eq.  (14.  51) 


Test 

Procedure 

A 

Cq  based  on  B 
Table  14.9 

A 

Cq  based  on 

A-1 

0.  0445 

0.  461 

■■ 

0.  0240 

A-2 

0.  0366 

0.  461 

■■■ 

0.  0197 

A-3 

0.  0554 

0.  461 

0.  539 

0.  0299 

A-4 

0. 0572 

0.  461 

0.  539 

0.  0308 

B-1 

0.  0402 

0.  461 

0.  539 

0.  0217 

B-2 

0.  0387 

0.  461 

0.  539 

0.  0208 

B-3 

0.  0391 

0.  461 

0.  539 

0. 0211 

B-4 

0.  0546 

0.  461 

0.  539 

0.  0294 

B-5 

0.  0643 

0.  461 

0.  539 

0.  0346 

C-1 

0.  0207 

0.  135 

0.  865 

0.  0179 

C-2 

0. 0224 

0.  135 

0.  865 

0.  0194 

C-3 

0. 0219 

0.  099 

0.  901 

0.  0197 

C-4 

0.  0215 

0.  092 

0.  908 

0.  0195 

D-1 

0.  038 

0.  003 

0.  997 

0.  038 

D-2 

0.  019 

0.  001 

0.  999 

0.  019 

D-3 

0.  026 

0.  000 

1.  000 

0.  026 

D-4 

0.  017 

0.  000 

1.  000 

0.  017 

D-5 

0.  038 

0.  000 

1.  000 

0.  038 

Table  14.  11  Experimental  Value  for  the  Coefficient  Cq 
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Although  Eq.  (14,  51)  presents  a  good  fit  to  the  experimental  data  gathered 
herein,  there  is  no  justification  for  its  general  use  since  the  equation  was 
arrived  at  by  arbitrary  methods  without  a  firm  theoretical  foundation. 
Nevertheless,  Eq.  (14.  51)  presents  an  interesting  consideration  for  future 
theoretical  and  experimental  studies  of  the  uncertainty  of  probability 
density  estimates. 

14.  5.  2  Estimation  Uncertainty  and  Measurement  Parameters  for 

Different  Signals 

Consider  the  hypothetical  case  where  the  probability  density 
function  for  a  stationary  random  signal  is  to  be  estimated  so  that  the 
normalized  standard  error  is  no  greater  than  10%,  i.  e.  ,  £  =0.  10.  Assume 
that  the  low  frequency  cutoff  of  the  signal  is  near  DC  so  that  Eq.  (14.  49) 
applies.  Also  assume  the  analysis  is  to  be  performed  with  an  amplitude 
window  width  of  0.  1  for  a  signal  rms  level  of  unity.  For  the  case  of  a 
Gaussian  probability  density  function,  the  association  among  the  values 
for  ^(x),  yQ,  and  is  as  shown  in  Table  14.  12. 


Required  Record  Length  T  s( 

for  Various  Amplitude  Levels  v. 

€  =  0.  10  Ax  =  0.  1  rms  =  1. 

jconds 

0 

v=  1.  0 

p  =0.2420 

V 

v  =  2.  0 

p  =0.0540 

v  =  3.  0 
p  =0.0044 

v  =  4.  0 

p  =0.0001 

10 

28. 

126. 

1540. 

68000 

100 

2.  8 

12.  6 

154. 

6800 

1000 

0.  28 

1.  26 

15.  4 

680 

10000 

0.  028 

0.  126 

1.  54 

68 

Table  14.  12  Record  Length  Required  for  10%  Standard  Error 


The  case  of  =  10  represents  a  signal  which  is  very  low  frequency 
in  nature;  for  example,  the  normal  mode  response  of  a  flight  vehicle  to 
gust  loads.  From  Table  14.  12,  a  record  length  of  1540  seconds  (25.7 
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minutes)  would  be  required  to  obtain  estimates  out  to  ±  3  rms  with  a 
normalized  standard  error  of  10%.  A  record  length  of  almost  19  hours 
would  be  required  to  obtain  estimates  out  to  ±  4  rms. 

The  case  of  =  1000  represents  a  signal  with  a  frequency  range 
characteristic  of  the  vibration  response  of  local  structure  in  flight 
vehicles.  From  Table  14.  12,  a  record  length  of  about  16  seconds  would 
be  required  to  obtain  estimates  with  t  =  0.  10  out  to  Jt  3  rms,  or  about  11 
minutes  out  to  i  4  rms. 

The  case  of  =  10000  represents  a  signal  with  a  frequency  range 
typical  of  acoustic  environments  in  flight  vehicles.  Here,  a  record 
length  of  only  1.  6  seconds  is  required  to  obtain  estimates  with  c  =  0.  1 
out  to  ±  3  rms,  or  a  little  over  a  minute  out  to  ±  4  rms. 

The  above  examples  clearly  illustrate  the  real  problems  in  obtaining 
statistically  accurate  probability  density  estimates  for  signals  which  are 
low  frequency  in  nature.  For  the  extreme  amplitudes  in  particular, 
relatively  long  sample  records  are  required  to  obtain  accurate  proba¬ 
bility  density  estimates,  even  for  signals  in  the  audio  frequency  range. 

14.6  CONCLUSIONS 

The  uncertainty  of  probability  density  estimates  has  been  investi¬ 
gated  by  carefully  designed  laboratory  experiments.  Two  slightly  different 
theoretical  expressions  for  uncertainty  are  compared  to  experimental  data. 
The  results  indicate  that  Eq.  (14.  49)  is  a  valid  representation  for  the 
normalized  variance  of  probability  density  estimates  for  a  wide  range  of 
practical  conditions.  However,  for  narrow  bandwidth  signals,  a  slightly 
different  theoretical  expression  given  by  Eq.  (14.  50)  appears  to  be  a  more 
valid  representation  for  the  normalized  variance  of  estimates. 

Neither  of  the  two  theoretical  uncertainty  expressions  considered 
appears  to  be  completely  valid  for  all  of  the  conditions  studied.  It  is 
believed  that  the  true  expression  for  estimation  uncertainty  is  more  general 
and  perhaps  involves  more  terms  than  the  expressions  developed  herein. 
Although  these  matters  are  not  completely  resolved,  an  empirical  ex¬ 
pression  for  the  normalized  variance  of  estimates  is  given  by  Eq.  (14.  51) 
which  is  a  reasonably  good  fit  for  the  data  gathered.  This  empirical 
expression  presents  a  guideline  and  motivation  for  future  theoretical  and 
experimental  studies  of  the  uncertainty  of  probability  density  estimates. 
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15.  TESTS  FOR  RANDOMNESS 


15.  1  THEORY  OF  TESTS  FOR  RANDOMNESS 
15.  1.  1  General  Remarks 

Before  discussing  quantitative  procedures  for  testing  vibration 
response  signals  for  randomness,  it  is  helpful  to  review  certain  qualita¬ 
tive  relationships  which  distinguish  random  signals  from  periodic  signals. 
Consider  the  properties  of  a  vibration  response  which  would  be  measured 
from  sample  records  as  a  normal  part  of  the  data  analyses.  These 
properties  would  probably  include  a  power  spectrum  (and/or  an  auto¬ 
correlation  function),  and  an  amplitude  probability  density  function. 

The  most  common  property  employed  to  describe  a  random  vibration 
response  is  the  power  spectrum,  G(f).  A  periodic  vibration  response 
would  appear  in  a  properly  resolved  power  spectral  density  estimate  as 
one  or  more  sharp  peaks.  However,  a  sharp  peak  in  the  power  spectrum 
may  also  represent  the  narrow  band  random  response  of  a  lightly  damped 
structural  resonance.  A  narrow  band  random  response  would  always  have 
a  finite  bandwidth  while  a  sinusoidal  response  would  theoretically  appear 
as  a  delta  function  with  no  bandwidth.  Unfortunately,  the  resolution  of 
actual  measurement  procedures  is  usually  not  sufficient  to  distinguish 
between  these  two  cases,  as  illustrated  in  Figure  15.  1. 

If  an  autocorrelation  function  is  available,  the  problem  of  distinguish¬ 
ing  between  a  sinusoidal  vibration  response  and  a  narrow  band  random 
vibration  response  is  greatly  simplified.  The  autocorrelation  function, 

R(t),  for  a  narrow  band  random  vibration  response  will  continually  decay 
towards  zero  as  the  time  displacement  t  becomes  large.  However,  if 
a  sine  wave  is  present,  the  autocorrelation  function  will  approach  a  steady 
state  oscillation  as  the  time  displacement  becomes  large,  as  illustrated 
in  Figure  15.  2, 

Autocorrelation  analysis  presents  a  near  foolproof  method  of  detect¬ 
ing  sinusoids  in  an  otherwise  random  vibration  response.  However, 
autocorrelation  functions  are  rarely  determined  when  vibration  data  is 
analyzed  using  analog  instruments.  On  the  other  hand,  when  vibration 
data  is  analyzed  by  digital  techniques,  autocorrelation  functions  are  often 
computed  as  an  intermediate  step  to  obtain  power  spectra  |  G(f)  is  the  Fourier 
transform  of  R(t)  for  stationary  random  signals  j.  In  this  case,  an  auto¬ 
correlation  function  can  be  made  available  for  detection  of  periodicities. 
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The  presence  of  periodic  components  in  a  vibration  response  will 
also  be  revealed  by  the  amplitude  probability  density  function  for  the 
response.  A  random  vibration  response  will,  in  most  cases,  have  a 
probability  density  function  which  at  least  resembles  the  familiar  bell¬ 
shaped  Gaussian  characteristic.  This  is  particularly  true  for  a  narrow 
band  random  response  (assuming  the  structural  characteristics  are 
reasonably  linear),  because  linear  narrow  band  filtering  of  random  signals 
tends  to  suppress  deviations  from  normality  in  the  amplitude  distribution 
characteristics.  On  the  other  hand,  a  sinusoidal  vibration  response  will 
have  a  disht- shaped  probability  density  function  which  is  truncated  at 
,  as  illustrated  in  Figure  15.  3. 

The  above  discussions  illustrate  how  periodicities  in  an  otherwise 
random  vibration  response  may  often  be  detected  by  simple  observations 
from  commonly  analyzed  data.  However,  these  interpretations  are  fully 
effective  only  when  sampling  errors  are  small.  If  the  available  sample 
records  (or  analyses  averaging  times)  are  short,  the  uncertainty  in  the 
resulting  measurements  may  mask  the  desired  descriptive  details  in  the 
various  estimated  properties.  Furthermore,  it  is  often  desirable  to 
determine  if  periodicities  are  present  in  an  otherwise  random  vibration 
response  before  the  data  analysis  has  proceeded  to  the  point  of  estimating 
correlation  or  probability  density  functions.  A  quantitative  procedure 
for  testing  sample  records  for  randomness  by  analysis  of  some  elementary 
property  of  the  vibration  signal  is  clearly  desirable. 

In  Ref.  [  I  Section  6.  1.  5,  a  test  for  randomness  based  upon  an 
analysis  of  zero  crossings  is  proposed.  This  procedure  suggested  in 
Ref.  ^  1  j  will  hereafter  be  referred  to  as  Randomness  Test  A.  An 
additional  test  for  randomness  based  upon  an  analysis  of  mean  square 
measurements  is  developed  and  presented  herein.  This  second  procedure 
will  hereafter  be  referred  to  as  Randomness  Test  B. 
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—  RESOLUTION  OF  ANALYSIS 
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.Its 

I  SINUSOIDAL  VIBRATION 
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G(f) 


G(f) 


Figure  15.  1  Power  Spectral  Density  Functions 
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SINUSOIDAL  VIBRATION 


Figure  15.  2  Autocorrelation  Functions 
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p(x) 


p(x) 


p(x) 


Figure  15.  3  Amplitude  Probability  Density  Functions 


ASD  TDR  62-973 


15-5 


15.  1.  2  Review  of  Randomness  Test  A 


Consider  a  stationary  random  signal  x(t)  with  a  mean  value  of 

zero.  Assume  x{t)  has  an  approximately  Gaussian  probability  density 

function  and  a  uniform  power  spectrum  between  the  frequency  limits 

f  and  f,  . 
a  b 

For  a  sample  record  of  length  T,  the  equivalent  number  of  events 
IS  given  by  n  =  2^qT  where  Uq  is  the  expected  number  of  zero  crossings 
per  second.  If  n  is  large,  say  greater  than  50,  the  number  of  zero 
crossings  measured  from  the  sample  record  will  have  an  approxi¬ 
mately  normal  sampling  distribution  with  a  mean  and  variance  as  follows. 


=  -  (15.  la) 

Uq  2 

2  ri(  y  ■  1 ) 

T  = - f -  (15.1b) 

^0  2(n-l) 


For  a  signal  with  a  uniform  power  spectrum  between  the  lower  and  upper 
frequency  limits,  f^  and  f^,  respectively,  the  term  y^  is  given  by 


a  b 


3 


1/2 


(15.  2) 


The  practical  validity  of  Eqs.  (15.  1)  and  (15.  2)  has  been  fully  substantiated 
by  the  experiments  presented  in  Section  12. 

The  above  relationships  may  be  employed  as  a  test  for  randomness. 
Assume  a  sample  record  of  length  T  is  obtained  from  a  stationary 
vibration  response  x(t).  The  number  of  zero  crossings  y^  in  the 
sample  record  is  counted.  If  x(t)  is  random,  the  measured  number  of 
zero  crossings  y^  should  be  equivalent  to  the  expected  number  of  zero 
crossings  p.  ,  given  theoretically  by  Eq.  (15.  1).  Then  a  hypothesis 
of  randomness  is  established  by  the  null  hypothesis  Hq  as  follows. 


Hn  :  Vn  = 


Vo 


(15.  3) 
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If  Hq  is  tested  at  the  a  level  of  significance,  the  region  of  acceptance 
IS  given  by 


'q/2 


-  Wc 


>  - 


Vo 


'a/2 


(15.4) 


where  z  is  a  normal  deviate. 
q/ 2 

Example ; 

The  above  discussions  will  be  clarified  by  considering  an  example. 
Assume  that  a  three -second  long  sample  record  is  obtained  from  a 
stationary  vibration  response  signal.  The  vibration  signal  is  to  be  tested 
for  randomness  at  the  5%  level  of  significance  by  investigating  the  zero 
crossings  in  the  sample  record.  Say  that  the  frequency  range  of  interest 
is  between  20  cps  and  500  cps,  and  that  the  vibration  signal  has  been 
filtered  with  ideally  sharp  cutoffs  at  these  frequencies.  Further,  assume 
that  the  vibration  signal,  if  random,  has  a  uniform  power  spectrum  and 
an  approximately  Gaussian  probability  density  function. 

Let  it  be  hypothesized  that  the  sample  record  was  obtained  from  a 
random  vibration  signal.  Then,  from  Eq.  (15.  2),  the  expected  number 
of  zero  crossings  per  second  will  be 


(20)^  +  (20)(500)  +  (500)^ 


1/2 


589.  2  crossings 


and  the  equivalent  number  of  events  represented  by  the  sample  record  is 


n  =  2(589.  2)  3  =  3535 

The  value  of  n  is  sufficiently  large  to  permit  a  normality  assumption 
for  the  sampling  distribution.  From  Eq.  (15.  1),  the  distribution  for  the 
actual  number  of  zero  crossings  Uq  in  the  sample  record  will  have  a 
mean  value,  variance,  and  standard  deviation  as  follows. 

Pj .  =  y  (3535)  =  1768  crossings 
I/q  ^ 

2  3535fi  3535  -  1) 

(T  = - = -  =  883.5 

^0  2(3535  -  1) 

O'  =  ~\J  883.  5  =  29.  7  crossings 

^0 
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To  test  at  a  5%  level  of  significance  (ja  =  0.  05),  the  region  of  acceptance 
will  be 

±  1.96a  =  1768  ±  58  =  (1710,  1826)  crossings 

^0 

The  actual  number  of  zero  crossings  which  occurred  in  the 
three -second  long  sample  record  would  now  be  counted.  If  (Vq  were 
between  1710  and  1826,  the  hypothesis  of  randomness  would  be  accepted, 
i.  e.  ,  the  vibration  signal  would  be  considered  as  random.  If  were 
less  than  1710  or  greater  than  1826,  the  hypothesis  of  randomness  would 
be  rejected,  i.  e.  ,  the  vibration  signal  would  be  considered  as  nonrandom. 
The  probability  of  a  Type  I  error  (risk  of  rejecting  the  hypothesis  when 
in  fact  it  is  true)  associated  with  the  decision  is  a  =  0.  05. 

One  might  be  interested  in  associating  a  Type  II  error  probability 
(risk  of  accepting  the  hypothesis  when  in  fact  it  is  not  true)  with  the 
decision.  The  development  of  a  totally  meaningful  Type  II  error  is  not 
really  feasible,  because  the  numerous  possible  conditions  of  nonrandom¬ 
ness  cannot  be  explicitly  defined.  However,  if  one  cares  to  make  several 
arbitrary  assumptions,  a  Type  II  error  with  limited  meaning  can  be 
applied  to  the  test.  For  example,  let  the  extent  of  nonrandomness  of  a 
vibration  signal  be  defined  by  the  expected  number  of  zero  crossings  per 
second.  Further,  assume  that  the  variance  of  the  sampling  distribution 
will  be  the  same  as  the  variance  of  samples  obtained  from  a  random 
signal.  A  Type  II  error  may  now  be  established  in  terms  of  this  definition 
of  nonrandomness. 

For  the  previous  illustration,  consider  the  detection  of  a  condition 
of  nonrandomness  defined  by  an  expected  number  of  zero  crossings  at 
least  5%  different  from  the  expected  zero  crossings  for  a  random  signal. 
Then,  the  mean  value  and  standard  deviation  of  the  sampling  distribution 
for  the  nonrandom  signal  will  be 

u  (low)  =  1680 
K) 

fi,  .  (high)  =  1856 
^0 


ASD  TDR  62-973 


15-8 


The  probability  of  a  sample  with  the  above  expected  values  falling  within 
the  a  =  0.  05  region  of  acceptance  (1710  to  1826)  for  the  test  is  0.  312. 
Thus,  the  Type  II  error  probability  is  31.  2%  for  detecting  a  5%  difference 
in  the  expected  number  of  zero  crossings.  By  the  same  procedure,  the 
Type  II  error  probability  is  10.  6%  for  detecting  a  6%  difference  in 
expected  zero  crossings,  2.  6%  for  detecting  a  7%  difference  in  expected 
zero  crossings,  etc. 


^5.  1.  3  Principles  of  Randomness  Test  B 

The  second  test  for  randomness  to  be  discussed  here  is  totally 
different  in  concept  from  Test  A  discussed  in  Section  15.  1.  2.  Random¬ 
ness  Test  B  is  based  upon  an  investigation  of  mean  square  measurements 
rather  than  zero  crossing  measurements. 

Consider  a  stationary  random  signal  x(t)  with  a  mean  value  of  zero 

2 

and  a  mean  square  value  of  cr^  .  Assume  x(t)  has  an  approximately 
Gaussian  probability  density  function  and  an  equivalent  ideal  bandwidth  of 
B.  It  is  important  to  note  that  the  power  spectrum  need  not  be  uniform 
as  long  as  an  equivalent  ideal  bandwidth  can  be  determined.  From 
Section  13.  5.  2,  the  sampling  distribution  for  a  mean  square  value  esti¬ 
mate,  X  ,  will  have  a  normalized  variance  given  by 


2  Var  (x^)  1 

i.//  BT. 


(15.5) 


where  Tj  is  the  averaging  time. 

Now  consider  the  case  where  x(t)  is  not  random.  Specifically, 
assume  a  periodic  component  is  present  in  an  otherwise  random  signal 
with  an  equivalent  ideal  bandwidth  of  B  cps.  That  is 


x(t)  =  p(t)  +  r(t)  (15.6) 

where  p(t)  is  the  periodic  portion  of  x(t),  and  r(t)  is  the  random  portion 
of  x(t). 
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Let  the  moments  of  x(t),  p(t),  and  r(t)  be  denoted  by  m^(x),  m^(p),  and 
m^(r),  respectively,  where 


m^(x)  = 


lim 
T— oo 


,  x(t)  dt  =  p 

T  I  '  ' 


m^tx)  = 


lim 

T-*oa 


lim 

T-^oo 


-T 

II  2,  ,  ^  2  2 

X  (t)  dt  =  0-^  -  u 


X  ■  X 


^  /  x^(t)  dt 


(15.  7) 


m^{x)  = 


lim 
T— oo 


I 

T 


x^t)  dt 


The  terms  m.(p)  and  m^{r)  are  defined  in  a  similar  manner. 

Assuming  that  the  mean  values  of  both  the  periodic  and  random 
portions  are  zero,  the  first  four  moments  far  the  periodic  and  random 
portions  are  as  follows 


mj(p)  =  0 

2 

ni2(p)  =  0-  (p) 
m^(p)  =  0 
m^ip)  =  [o'^(p) 


mj(r)  =  0 

m2(r)  =  o-^(r) 
m^(r)  =  0 

m4(r)  =  3[(r^(r)]^  * 


(15.8) 


The  variance  of  a  measured  mean  square  value  based  upon  n  =  2BTj 
number  of  events  is  theoretically  given  by 

2 

— 7  nri  .(x)  -  m,(x) 

Var(x  )=  — - = -  (15.9) 

2BTj 

See  Ref.  [2]  ,  p.289,  for  a  derivation. 
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From  Eq.  (15.  7),  the  value  of  the  fourth  moment,  m^(x),  is  given  by 
■T 


m 


.(x)  =  lim  [p(t)+r(t)]^ 

T-coJo  ^  ^ 


dt 


0 

-T 


=  lim  [p^(t)  +  4p^(t)r{t)  +  6p^(t)r^(t)  +  4p(t)r^(t)  +  r^(t)j 

Jo 


(15.  10) 
dt 


Assuming  that  p(t)  and  r(t)  are  independent,  and  noting  that  the  first  and 
third  moments  of  both  are  zero,  Eq.  (15.  10)  reduces  to  the  following. 


m^(x)  =  m^(p)  +  6m2(p)m2(r)  +  m^(r) 


Now  the  second  moment,  m2(x),  is  given  by 

■T 

I 

m2(x)  =  lim 


T-I.00 


lim 

T-^oo 


I  [p(t)+r(t)]^  dt 
Jo 

/  [p^(t)  +  2p(t)r(t)  +  r^(t)  J  dt 

Jo 


=  m,(p)  +  m.,(r)  =  rr  since  u  =0 

Then,  the  square  of  the  second  moment  will  be 

2  2  2 
m2(x)  =  m2(p)  +  2m2(p)m2(r)  +  m2(r) 


(15.  11) 


(15.  12) 


(15. 13) 


Substituting  Eqs.  (15.  11)  and  ( 15.  13)  into  Eq.  ( 15.  9),  and  noting  the 
relationships  presented  in  Eq.  (15.  8),  the  following  result  is  obtained 


2,  2o-^(r)  [2o-^(p)  +  cr^(r)] 

Var  (x  )  - - i - - 


2BT, 


(15.  14) 
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In  terms  of  the  normalized  variance  t  ,  Eq.  (15.  14)  becomes 

€  ^  =  Vsir  {1? )  _  <r^(r)  [2o-^(p)  +  (r^(r)] 

[o-^^  ^  BTj[o-^p)  +  o-^(r)]  ^ 


(15.  15) 


For  simplicity,  let  the  term  (p/r)  denote  the  ratio  of  mean  square  values 
for  the  periodic  and  random  portions.  That  is, 


£  =  (P) 

■■  'Pw 


(15.  16) 


Now  Eq.  ( 15.  15)may  be  written  as  follows. 


2  £  +1 
r 


BT  +  1 


(15.  17) 


Note  that  if  the  signal  x(t)  is  only  periodic,  the  ratio  p/r  approaches 
2 

infinity  and  «  =  0  as  it  should,  since  there  is  no  variability  associated 

with  the  measurement  of  mean  square  values  for  periodic  signals. 

2 

Also,  if  x(t)  is  only  random,  the  ratio  p/r  is  zero  and  €  =  1/BTj  , 

which  is  the  correct  normalized  variance  for  mean  square  values 

associated  with  a  random  signal,  as  defined  in  Eq.  (15.  5).  For  clarity, 

let  the  normalized  variance  for  a  measured  mean  square  value  of  a 

2 

random  signal  alone  be  denoted  by  «  That  is, 


2 

€  = 
O 


(15.  18) 


Substituting  Eq.  (15.  18)  into  Eq.  (15.  17)  gives  the  following  relationship, 


(15.  19) 


Equation  (15.  19)  lays  the  groundwork  for  a  statistical  test  for 
randomness.  Assume  a  collection  of  N  independent  mean  square  values, 
x^  (i  =  1,  2,  3, .  .  .  ,N),  are  measured  from  a  stationary  vibration 


(z  l'] 

1  2 

£ 

1  O 

(p+1 

1 
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response  signal.  Each  measured  value  x.  constitutes  an  estimate  of 

2  ^ 

.  This  collection  may  be  obtained  from  a  single  sample  record  of 

length  T  by  averaging  over  each  of  N  equally  long  segments  with  an 

averaging  time  of  T-  =  T/N.  The  variance  of  the  measured  mean 

^  2 

square  values  can  be  estimated  from  the  sample  variance  s  as  follows. 


2 

s 


-^.2 
X  ) 


(x  ) 


where 


{15.  20)* 


Here,  x  is  the  mean  square  value  averaged  over  the  collection  length 
T  =  NT^.  Then,  the  normalized  variance  for  a  mean  square  value 
measurement  may  be  estimated  by 


.“Z.  2 

(  X  ) 


(15.  21) 


2 

In  Eq.  (15.  21),  both  s  and  x  are  random  variables.  However,  it  is 

~~1  2 

shown  in  Section  13.  5.  3  that  the  variability  of  the  term  (x  )  is  small 

7 

compared  to  the  variability  of  s**  if  the  quantity  BT  •  is  large,  say 

^  2  2 

greater  than  10.  In  this  case,  it  may  be  assumed  that  x  =  (r^  for  the 
problem  at  hand. 

2 

The  sample  variance  s  from  Eq.  (15.  20)  will  have  a  distribution 
associated  with  the  chi-squared  distribution  as  follows. 


2  2 
s  ^  X 

Var  ("j^  )  N 

where  means  "distributed  as",  and  is 

with  (N  -  1)  degrees  of  freedom. 


(15.  22) 

a  chi -squared  distribution 


A  biased  expression  for  s  is  employed  here  so  that  all  statistical 
procedures  to  follow  will  be  consistent  with  procedures  outlined  in 
Ref.  [  ij  . 
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From  the  relationships  in  Eq.  (15.  21),  it  follows  that 


(15.23) 


From  Eq.  (15.  23),  the  following  probability  statement  may  be  made. 


r/s  2 


Prob 


-(1-ct) 

N 


=  (1.Q) 


(15.24) 


where  a  is  the  level  of  significance. 

Let  it  be  hypothesized  that  a  sampled  vibration  response  is  random. 
2  2 

If  this  is  true,  e  =  <  ,  and  the  hypothesis  Hq  is 


„  a2  2 
0  o 


(15.  25) 


If  a  periodic  component  is  present,  ^  will  be  equivalent  to  some  £  less 
2 

than  as  defined  in  Eq.  (15.  19),  which  is  why  a  one-sided  probability 

statement  is  used  in  Eq.  (15.  24).  Then,  H«  may  be  tested  by  computing 

2  ^2 
■£  from  a  collection  of  mean  square  measurements,  computing  from 

the  BT,  product  for  the  measurements,  and  comparing  the  ratio  of 
2  2^  2 

'€  fi  ^  to  the  X  limit  in  Eq.  (15.  24)  at  any  desired  level  of  significance 
a  .  The  region  of  acceptance  for  is 


a2 

€ 


2 

^1-q) 

N 


(15.  26) 


/.  2  2 

If  £  /£^  is  greater  than  the  above  noted  limit,  Hq  is  accepted  and  vibra¬ 

tion  response  is  considered  random.  If  ■£  /£^  is  less  than  the  noted 
limit,  Hq  is  rejected  and  there  is  reason  to  suspect  that  a  periodic  com¬ 
ponent  is  present  in  the  vibration  response.  A  plot  of  Eq.  (15.  26)  for 
a  =  0.  01  and  0.  05  is  presented  in  Figure  15.  4. 

The  level  of  significance  a  is  the  probability  of  a  Type  I  error  for 
the  test.  The  risk  of  a  Type  I  error  may  be  reduced  by  testing  with  a 

smaller  value  of  a.  Now  consider  the  probability  of  a  Type  II  error  denoted 

2  2 

by  p.  P  is  a  function  of  a,  N,  and  the  deviation  of  £  from  £  which  one 
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Figure  15.  4  Acceptance  Regions  for  Randomness  Test  B 


wishes  to  detect.  In  general,  both  a  and  P  can  be  reduced  only  by  in¬ 
creasing  the  number  of  measurements  N.  The  number  N  required  for 
any  value  of  a  and  P  is  given  by  the  Operating  Characteristic  (OC) 
curves  for  Eq.  ( 15.  26).  The  OC  curves  for  a  =  0.  05  and  0.01  are  avail¬ 
able  in  Figures  6.  19  and  6.  20  of  Ref.  |  3  j  .  Note  that  the  referenced  OC 
curves  are  developed  for  unbiased  variance  estimates.  However,  this 
does  not  affect  the  application  of  the  curves  to  the  problem  here  as  long 
as  the  region  of  acceptance  is  consistent  with  the  method  of  computing  , 
as  shown  in  Eq.  ( 15.  26). 

In  summary,  the  procedure  for  applying  Randomness  Test  B  is  as 
follows. 

1.  Determine  the  magnitude  of  a  periodic  component  in  terms  of  a 

p/r  ratio  which  one  wishes  to  detect  with  high  probability. 

2  2 

2.  Determine  the  ratio  (  /i  ^  for  that  p/r  ratio  from  Eq.  (15.  19). 

3.  Determine  the  desired  values  for  a  and  P,  the  risk  of  making  a 
Type  I  and  Type  II  error. 

4.  Determine  the  number  of  measurements  N  required  from  an  OC 

Z 

curve  for  a  one-sided  (lower  tail)  x  test. 

5.  Obtain  the  required  number  of  mean  square  measurements,  x.  , 

2  ^ 
and  compote  «  from  Eq.  (15.  21). 

6.  Compute  €  ^  from  Eq.  (15.  18). 

^  /\  2  2  2  2 

7.  Test  the  ratio  'i.  against  Hq  :  *  = 

It  should  be  noted  that  the  effectiveness  of  the  procedure  will  increase 
as  the  bandwidth  B  is  made  small.  Thus,  if  a  sharp  peak  is  observed 
in  the  power  spectrum,  the  frequency  range  of  the  peak  should  be  isolat,ed 
by  a  narrow  band  filter.  If  the  peak  represents  a  sine  wave,  the  random 
portion  within  the  narrow  bandwidth  B  will  be  very  small,  causing  a  large 
p/r  ratio.  This  not  only  improves  the  power  of  the  test,  but  it  helps  to 
define  the  value  of  B  needed  to  compute  «  ^  . 

Example : 

The  above  discussions  will  be  clarified  by  considering  an  example. 
Assume  that  a  three- second  long  sample  record  is  obtained  from  a 
stationary  vibration  response  signal.  The  vibration  signal  is  to  be  tested 
for  randomness  at  the  5%  level  of  significance  by  investigating  the  variance 
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of  mean  square  measurements.  Assume  that  a  power  spectrum  measured 
from  the  sample  record  using  a  50  cps  wide  filter  reveals  a  peak  with  a 
magnitude  that  is  about  ten  times  greater  .than  the  power  spectral  density 
at  neighboring  frequencies.  The  frequency  range  of  the  test  for  random¬ 
ness  should  be  limited  to  this  suspicious  peak. 

Assume  the  50  cps  narrow  band  pass  filter  is  tuned  over  this  10:1 
peak.  Let  it  be  hypothesized  that  the  signal  within  this  bandwidth  is 
random.  It  is  desired  that  a  p/r  ratio  of  ten  be  detected  with  a  Type  II 
error  probability  of  P=  0.05.  From  Eq.  (15.  19) 


2 


e 


o 


(20  +  1) 

(10  +  1)'^ 


=  0.  174  for  £. 

r 


10 


From  Figure  6.  19  of  Ref.  ^  3  j  ,  for  (i  =  0.  174  {  \  =  t  ft  ^  =  0.  42)  and 

Q  =  P  =  0.  05,  the  required  number  of  mean  square  measurements  is  N  =  9. 


The  three -second  long  sample  record  is  now  divided  into  nine  equal 
segments,  each  T^  =  0.  33  seconds  long.  Note  that  BTj  =  16.  5  10.  The 

mean  square  level  for  each  segment  is  measured  and  the  estimated  nor¬ 
malized  variance  is  computed  using  Eq.  (15.  21).  From  Eq.  (15.  26), 
for  N  =  9,  the  region  of  acceptance  is 


/^2 

1_  S  0.  332 
2 

€ 

O 

2  2 
From  Eq.  ( 15.  18),  <  ^  =  0.  0606,  so  the  acceptance  region  for  t  becomes 


*  0.  0201 


2 

If  ^  is  greater  than  the  above  limit,  the  hypothesis  of  randomness  is 
accepted.  If  is  less  than  the  above  limit  the  hypothesis  of  randomness 
is  rejected  and  there  is  reason  to  suspect  that  the  peak  in  the  power  spec¬ 
trum  represents  a  sine  wave. 
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15.  1.4  Bandwidth  and  Averaging  Time  Considerations 


Randomness  Test  A,  as  originally  proposed  in  Ref.  [  1  Ji 
requires  that  the  equivalent  ideal  lower  and  upper  cutoff  frequencies, 
f^  and  f^,  be  known  for  the  signal  under  investigation.  The  method  for 
computing  f^  and  fj^  is  developed  and  presented  in  Section  12.  3.  2, 

Randomness  Test  B  proposed  here  requires  that  the  normalized 
variance  be  known  for  the  signal  under  investigation  (when  that 

signal  is  assumed  to  be  random).  From  Eq.  (15.  18),  is  a  function  of 
the  equivalent  ideal  signal  bandwidth  B  and  the  averaging  Time  Tj  for 
each  mean  square  estimate.  Bandwidth  and  averaging  time  considera¬ 
tions  are  discussed  in  Section  13.  1.  3.  However,  some  additional  dis¬ 
cussion  is  warranted  here. 

(a)  Bandwidth  Considerations 

The  general  procedures  for  computing  an  equivalent  ideal  band¬ 
width  for  a  filtered  random  signal  are  discussed  in  Section  13.  1.  3,  and  in 
greater  detail  in  Section  16.  1.  5(a).  For  the  problem  at  hand.  Random¬ 
ness  Test  B  is  most  effective  when  applied  to  isolated  peaks  in  the  power 
spectrum  of  the  signal  being  studied.  Each  peak  may  represent  a  sine 
wave  or  a  narrow  band  random  signal. 

It  is  assumed  for  application  of  the  test  that  a  peak  represents  a 
narrow  band  random  signal.  A  narrow  band  filter,  such  as  the  filter 
incorporated  in  a  power  spectral  density  analyzer,  may  be  tuned  over  a 
power  spectral  density  peak  to  isolate  it  from  the  remainder  of  the  signal. 
The  filter  bandwidth  B  should  be  selected  so  that  it  is  less  than  the 
apparent  width  of  the  peak  as  indicated  from  a  power  spectral  density 
plot.  Naturally,  if  the  peak  were  a  sine  wave,  the  apparent  width  would 
be  equal  to  the  bandwidth  of  the  filter  used  for  the  power  spectrum 
measurement.  In  any  case,  the  bandwidth  B  needed  for  Eq.  (15.  18)  may 
now  be  assumed  to  be  the  bandwidth  of  the  narrow  filter  employed.  This 
greatly  simplifies  the  application  of  Randomness  Test  B  to  real  data. 

(b)  Averaging  Considerations 

The  ideal  method  of  averaging  is  by  linear  integration  over  the 
desired  time  interval,  T^-  However,  averaging  is  often  accomplished  by 
continuous  smoothing  with  a  low  pass  RC  filter  having  a  time  constant  K. 
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The  general  associations  between  the  time  constant  K  and  the  equivalent 
averaging  time  Tj  are  discussed  in  Section  13.  1.  3.  There  are  special 
considerations  which  apply  to  the  present  problem. 

Assume  a  long  record  of  length  T  is  to-  be  tested  for  randomness 
by  analysis  of  a  continuous  RC  averaged  mean  square  estim9.te  as 
shown  in  Fig  ure  15.  5. 


T  time 

Figure  15.  5  Analysis  of  Continuous  Mean  Square  Levels 


Let  the  time  constant  K  be  short  as  compared  to  T;  that  is,  K  ^  T. 
Now  divide  the  continuous  mean  square  estimate  into  N  equal  intervals 
such  that  each  interval  is  about  3K  or  4K  long.  The  level  of  the  con¬ 
tinuous  mean  square  estimate  at  the  end  of  each  interval  will  constitute 
a  mean  square  measurement  based  on  an  equivalent  averaging  time  of 
Tj  =  2K.  The  individual  readings  should  be  3K  or  4K  apart  to  assure  that 
they  are  statistically  independent.  Note  that  the  points  at  which  readings 
are  made  can  also  be  selected  by  random  sampling.  Under  no  circum¬ 
stances,  however,  should  the  points  be  selected  without  a  pre -designated 
plan  (equal  intervals  or  random  intervals).  Otherwise,  the  person 
reducing  the  data  may  bias  the  results. 
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15.  2 


DESIGN  OF  EXPERIMENTS  AND  PROCEDURES 


15.  2.  1  General  Design  and  Procedures 

The  general  purpose  of  these  experiments  is  twofold.  The 
first  is  to  study  the  practicability  of  Randomness  Test  A.  The  founda¬ 
tion  of  Test  A  is  based  upon  zero  crossing  theory  which  is  substantiated 
in  Section  12.  The  second  objective  is  to  verify  the  theoretical  founda¬ 
tion  for  Randomness  Test  B. 

No  additional  data  over  that  presented  in  Section  12  is  needed  to 
accomplish  the  first  objective.  Thus,  all  the  new  experiments  performed 
in  this  section  are  concerned  with  Randomness  Test  B. 

15.  2.  2  Procedure  for  Verifying  Randomness  Test  B 

The  objective  is  to  confirm  the  validity  of  Eq.  (15.  19),  which 
is  the  basis  for  Randomness  Test  B.  The  verification  procedure  is  to 
collect  N  number  of  mean  square  measurements  from  a  signal  consist¬ 
ing  of  a  sine  wave  in  a  random  signal  background.  An  estimated 

2 

normalized  variance  t  is  computed  using  Eqs.(15.  20)  and  (15.  21). 

2 

The  resulting  value  for  ^  is  then  tested  for  equivalence  to  the  theoreti- 

2 

cal  value  for  «  computed  using  Eq.  (15.  19).  The  experiment  is 

repeated  for  several  different  (p/r)  ratios.  Note  that  the  bandwidth  and 

2 

averaging  time  relationships  associated  with  the  value  of  c  ^  in  Eq. 

(15.  19)  are  fully  substantiated  by  experiments  performed  in  Section  13. 
Thus,  it  is  considered  sufficient  here  to  study  Eq.  (15.  19)  for  only  one 
set  of  values  for  B  and  T^. 

More  specifically,  a  random  signal  with  a  bandwidth  of  B  =  56  cps 

on  a  center  frequency  of  f^  =  1000  cps  is  mixed  with  a  sine  wave  having 

a  frequency  of  f^  =  1000  cps.  A  total  of  N  =  61  consecutive  mean  square 

measurements  are  obtained  by  averaging  with  a  low  pass  RC  filter  having 

a  time  constant  of  K  =  0.  16  seconds  (T^  =  0.  32  seconds).  Thus,  from 

Eq.  (15.  18),  =  (l/BT^  =  0.  056. 

The  experiment  is  performed  for  five  different  p/r  ratios  producing 

2 

five  different  expected  values  for  «  from  Eq.  (15.  19)  as  follows. 


1. 

p/r  =  0 

€^  =  0.056 

2. 

p/r  =  1 

;  €^  =  0.042 

3. 

p/r  =  2 

€  ^  =  0.  031 

4. 

p/r  =  4 

=  0.  020 

5. 

p/r  =  9 

;  €  ^  =  0.  011 
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2 

For  each  experiment,  ^  is  computed  from  the  N  =  61  mean  square 

2 

measurements  using  Eq.  (15.  20)  and  (15.  21).  The  values  for  "e  are 

effectively  variance  estimates  (since  BT.  *  15),  and  will  have  a  sampling 

2  ^ 

distribution  associated  with  the  x  distribution  as  given  in  Eq.  (15.  23). 
Thus,  the  following  probability  statement  may  be  made. 


Prob 


^(l-a/2) 

N 


(1  -  Q) 


(15.  27) 


For  each  of  the  five  (p/r)  ratios,  let  it  be  hypothesized  that  the 
experimfentally  determined  value  is  equivalent  to  the  theoretical 
value  i  ^  predicted  by  Eq.  (15.  19).  This  hypothesis,  Hq,  is  to  be  tested 
at  the  Q  =0.05  level  of  significance.  Then,  from  Eq.  (15.  27),  the 
region  of  acceptance  will  be  as  follows. 


0.  66  *  —  *  1.  37  (15.  28) 

2 


If  the  experimental  to  theoretical  variance  ratio  falls  within  the  above 

noted  limits,  Hq  is  accepted  and  Eq.  (15.  19)  is  considered  to  be  valid. 

If  the  ratio  falls  outside  the  noted  limits,  Hq  is  rejected  and  there  is 

reason  to  question  the  practical  validity  of  Eq.  (15.  19). 

Note  that  the  test  for  equivalence  used  here  is  exactly  the  same  as 

is  employed  for  the  experiments  in  Section  13.  The  Type  I  and  Type  II 

error  considerations  are  as  developed  and  discussed  in  Section  13.  2.  3. 

The  probability  of  a  Type  I  error  for  the  test  of  Hq  is  at  least  a  =  0.  05. 

The  probability  of  a  Type  II  error  for  the  test  of  H«  is  at  least 

2^  2 

P  =0.05  for  detecting  a  2:1  difference  between  t  and  <  (a  1.4:1 
difference  between  ^  and  « ). 
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15.  3 
15.  3.  1 


INSTRUMENTATION 
Instruments  and  Test  Set-up 


The  laboratory  instruments  employed  for  these  experiments 
are  listed  in  Table  15.  1.  A  block  diagram  for  the  test  set-up  is  illus¬ 
trated  in  Figure  15.  6.  Except  for  the  random  noise  generator,  all 
instruments  are  the  property  of  the  Norair  Division  of  Northrop  Corpora¬ 
tion,  and  were  in  current  calibration  at  the  time  of  the  experiments. 

The  random  noise  generator  (Item  A)  is  used  as  the  source  of  a 
signal  which  is  considered  in  these  experiments  to  be  a  stationary 
random  signal.  The  detailed  characteristics  of  this  instrument  are 
presented  in  Section  14.  3. 

The  sine  wave  generator  (Item  B)  is  used  as  a  source  of  a  signal 
which  is  known  to  be  nonrandom.  This  item  is  also  employed  for 
calibration  purposes  as  discussed  in  Section  15.  3.  2.  The  frequency 
counter  (Item  C)  determines  the  frequency  of  the  sinusoidal  signal  with 
an  accuracy  of  ±  1  cps. 

The  sine  wave  -  random  noise  mixer  (Item  D)  is  used  to  create  a 
controlled  nonrandom  signal  with  a  defined  (p/r)  ratio.  The  narrow 
band  pass  filter  (Item  E)  is  employed  to  band  limit  the  frequency  range 
of  the  signal  to  be  investigated.  The  characteristics  and  calibration  of 
this  filter  are  discussed  in  Section  15.  3.  2.  The  voltmeter  (Item  F) 
measures  the  rms  voltage  level  of  the  signal  to  be  investigated. 

The  mean  square  level  analyzer  (Item  G)  is  used  to  obtain  a  con¬ 
tinuous  RC  averaged  mean  square  level  estimate.  This  instrument  is 
a  true  RMS  voltmeter  with  an  analog  mean  square  level  output.  The 
strip  chart  recorder  (Item  H)  records  the  mean  square  level  time 
history  samples  for  the  signal  to  be  investigated. 

15.  3.  2  Calibration  of  Test  Set-up 

The  exactness  of  the  experiments  is  dependent  primarily  upon 
the  accurate  knowledge  of  two  parameters,  namely  the  bandwidth  B  and 
the  averaging  time  T^.  The  filter  employed  to  obtain  the  narrow  band¬ 
width  of  B  =  56  cps  is  the  same  filter  used  for  some  of  the  experiments 
in  Section  13.  The  characteristics  of  this  filter  are  discussed  in 
Section  13.  3.  2.  The  time  constant  of  K  =  0.  16  seconds  for  the  mean 
square  level  circuit  of  Item  G  is  determined  using  the  calibration 
procedures  detailed  in  Section  13.  3.  3. 
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Item 

Description 

Manufacturer 

Model 

No. 

Serial 

No.  * 

A 

Random  Noise 
Generator 

General  Radio  Co. 

937 

B 

Audio  Oscillator 

Hewlett-Packard 

67117 

C 

Universal  EPUT  and 
Timer 

Berkeley  Division 

7350 

79528 

D 

Sine  Wave -Random 
Noise  Mixer 

Northrop  Corporation 

-  .  -  - 

— 

E 

Narrow  Band  Pass 
Filter 

Technical  Products  Co. 

NC  44065 

F 

True  RMS  Voltmeter 

B  &  K  Instruments 

2409R 

PR-13147-1 

G 

Mean  Square  Level 
Analyzer  (True  RMS 
Voltmeter) 

Ballantine 
Laboratories,  Inc. 

320 

1149 

H 

Strip  Chart  Recorder 

Brush  Instruments 

Mark  II 

270822 

Except  for  Item  A,  the  serial  numbers  refer  to  Northrop  Corporation 
identification  tags. 

This  filter  is  part  of  a  TPC  power  spectral  density  analyzer. 
See  Table  13.  1. 

Table  15.  1  Instruments  Employed  for  the  Experiments 


I _ 

Figure  15.  6  Block  Diagram  of  Test  Set-Up 
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The  required  (p/r)  ratio  for  the  signal  to  be  investigated  is  estab¬ 
lished  as  follows.  The  random  signal  alone  is  applied  from  Item  A  and 
adjusted  to  read  out  the  desired  level  at  Item  F,  which  has  a  long  time 
constant  that  minimizes  uncertainty  fluctuations.  The  gain  setting  on 
Item  A  required  to  obtain  the  desired  level  is  noted.  The  sine  wave 
alone  is  then  applied  from  Item  B  and  adjusted  to  read  out  the  desired 
level  at  Item  F.  The  gain  setting  of  Item  B  required  to  obtain  the 
desired  level  is  noted.  The  sine  wave -random  signal  combination  is 
obtained  by  adjusting  the  gain  settings  on  Items  A  and  B  to  the 
previously  noted  positions.  The  individual  signals  as  well  as  the 
combined  signal  are  also  recorded  by  Item  H  as  a  check. 

15.  4  RESULTS  OF  EXPERIMENTS 
15.  4.  1  Mean  Square  Value  Data 

The  6l  mean  square  values  gathered  for  each  of  the  five  (p/r) 
ratios  are  presented  in  Table  15.  2, 

15»4.  2  Sampling  Statistics  for  Mean  Square  Value  Estimates 

The  sample  mean  and  variance  for  the  61  mean  square  values 
gathered  for  each  of  the  five  experiments  are  presented  in  Table  15.  3. 
The  sample  mean  and  variance  are  computed  using  Eq.  (15.  20). 
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Mean  Square  Value  Estimates  for  Ratios  of  (p/r)=(r  (p)/cr  (r) 
f  =  1000  cps;  B  =  56  cps;  K  =  0.  16  (T,  =0.  32);  f-  =  1000  cps 
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2  2 

Sample  Mean  x  and  Sample  Variance  s 

For  Mean  Square  Value  Estimates  x^ 

Description  of 
Experiment 

Sample 
Size  N 

Sample 

Mean 

Sample 

Variance  s 

1.  (p/r)  =  0 

61 

2.  057 

0.  192 

2.  (p/r)  =  1 

61 

1.  862 

0,  162 

3.  (p/r)  =  2 

61 

2.  000 

0.  129 

4.  (p/r)  =  4 

61 

2.  050 

0. 0653 

5.  (p/r)  =  9 

61 

1.  914 

0.  0341 

Table  15.  3  Sample  Means  and  Variances  for 


Mean  Square  Value  Estimates 


15.  4.  3  Results  of  Statistical  Tests 

/^2  2 

Tests  of  the  null  hypothesis,  Hq  :  «  =  «  ,  are  presented  in 

Table  15.  4.  The  hypothesis  Hq  is  accepted  for  all  five  experiments 
with  a  minimum  probability  of  a  Type  I  and  Type  II  error  of  5%. 

Thus,  there  is  no  reason  to  question  the  validity  of  Eq.  (15.  19)  for  the 
range  of  (p/r)  ratios  tested. 


Statistical  Test  of  Hypothesis  Hq  :  «  ^ 

i  2 

=  € 

Experiment 

€  ^  from 

o  2 

A  ^  S 

Region  of  Acceptance 
for 

Eq.  (15.  19) 

(x  ) 

2 

€ 

0.  66^  —  2  1.  37 

€ 

1.  (p/r)=0 

0.  056 

0.  045 

0.  80 

accepted 

2.  (p/r)=l 

0.  042 

0.  047 

1.  1 

accepted 

3.  (p/r)  =  2 

0.  031 

0.  032 

1.  0 

accepted 

4.  (p/r)  =  4 

0.  020 

0.  016 

0.  80 

accepted 

5.  (p/r)=9 

0.011 

0. 0093 

0.  84 

accepted 

Table  15.4  Statistical  Tests  for  Equivalence 
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15.  5 
15.  5.  1 


DISCUSSION  OF  RESULTS 
Randomness  Test  A 


The  effectiveness  of  Randomness  Test  A  may  be  studied  using 
the  zero  crossing  data  presented  in  Section  12.  Consider  first  the  zero 
crossings  measured  for  random  signals  with  uniform  power  spectra. 

This  data  is  designated  as  Area  A  in  Section  12  and  is  presented  in 
Table  12.  2.  Apply  Randomness  Test  A  to  this  data  (A-1  through  A-3 
in  Table  12.  2)  at  the  a  =  0.  05  level  of  significance. 

A-1.  Sample  records  with  length  T  =  0.  03  seconds  and  frequency 

range  f  =  28.  5  cps  to  f.  =  2100  cps,  giving  n  =  146.  49  events 

cL  D 

per  record. 

From  Eq.  (15.  1),  the  sampling  distribution  of  zero  crossings 
will  have  a  mean  and  variance  of 


73.  24 


36.  37 


For  a  5%  level  of  significance,  the  acceptance  region  for  the  number  of 
zero  crossings  in  a  sample  record  from  a  random  signal  is 


±  1.  96<r  =  73.  24  i  11.  82 

^0  ^0 

Then,  if  it  is  hypothesized  that  each  sample  record  is  obtained  from  a 
random  signal,  the  hypothesis  will  be  accepted  at  the  5%  level  of  signifi¬ 
cance  if  the  number  of  zero  crossings  is  between 

62  2  i/  2  85 
0 

From  Table  12.  2,  for  the  31  sample  records  gathered,  the  hypothesis  of 
randomness  is  accepted  for  29  of  the  sample  records,  and  erroneously 
rejected  for  two  of  the  sample  records  (Samples  No.  3  and  28).  Two 
Type  I  errors  out  of  31  tests  at  the  5%  level  of  significance  is  what  one 
would  anticipate. 
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A-2.  Sample  records  with  length  T  =  0.  05  seconds  and  frequency 

range  f  =  28.  5  cps  to  £,  =  1050  cps,  giving  n  =  122.  92  events 

Si  D 

per  record. 

For  this  case,  the  sampling  distribution  of  zero  crossings  will 
have  a  mean  and  variance  of 

p  =  61.  46 
<T^  =  30.  48 

For  a  5%  level  of  significance,  the  acceptance  region  for  the  number  of 
zero  crossings  in  a  sample  record  from  a  random  signal  is 

fi  ±  1.  96(r  =  61.  46  ±  10.  82 

^0  ^ 

Then  a  hypothesis  of  randomness  will  be  accepted  at  the  5%  level  of 
significance  if  the  num.ber  of  zero  crossings  is  between 

1/  2  72 
0 

From  Table  12.  2,  for  the  31  sample  records  gathered,  the  hypothesis  of 
randomness  is  accepted  for  30  of  the  sample  records,  and  erroneously 
rejected  for  one  sample  record  (Sample  No.  6).  Once  again,  one  Type  I 
error  out  of  31  tests  at  the  5%  level  of  significance  is  consistent. 

A-3.  Sample  records  with  length  T  =  0.  10  seconds  and  frequency 
range  f  =95  cps  to  f,  =  630  cps,  giving  157.  61  events  per 

3.  D 

record. 

For  this  case,  the  sampling  distribution  of  zero  crossings  will 
have  a  mean  and  variance  of 


78.  80 


=  39.  14 
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For  the  5%  level  of  significance,  the  acceptance  region  for  the  number 
of  zero  crossings  in  a  sample  record  from  a  random  signal  is 

±  1.  96a  =  78.  80  ±  12.  27 

Then  a  hypothesis  of  randomness  will  be  accepted  at  the  5%  level  of 
significance  if  the  number  of  zero  crossings  is  between 

672  91 

From  Table  12.  2,  for  the  31  sample  records  gathered,  the  hypothesis 
of  randomness  would  be  accepted  for  28  of  the  sample  records,  and 
erroneously  rejected  for  three  sample  records  (Samples  No.  11,  9,  and 
20).  Three  Type  I  errors  out  of  31  tests  at  the  5%  level  of  significance 
is  reasonable. 

Consider  next  the  zero  crossings  measured  for  nonrandom  signals 
consisting  of  sine  wave-random  combination  signals.  This  data  is 
designated  as  Area  C  in  Section  12  and  is  presented  in  Table  12.  3.  Apply 
Randomness  Test  A  to  this  data  (C-1  through  C-9  in  Table  12.  3)  at  the 
Q  =  0.  05  level  of  significance.  Note  that  for  this  illustration,  the  Type  II 
error  of  the  test  is  of  primary  importance,  since  it  is  desired  to  demon¬ 
strate  the  ability  of  the  test  to  reject  a  hypothesis  of  randomness  for 
signals  which  are  truly  nonrandom.  The  number  of  events  represented 
by  each  sample  record  in  Table  12.  3  is  less  than  n  =  160.  For  a  test  at 
the  5%  level  of  significance,  the  Type  II  error  would  be  unreasonably 
large.  However,  to  facilitate  the  desired  illustrations,  a  sample  record 
representing  a  much  larger  number  of  events  can  be  created  by  simply 
adding  together  all  31  sample  records  gathered  under  each  Test  Pro¬ 
cedure  to  form  one  long  record  for  each  experiment. 

C-1  through  C-4.  Sample  records  with  length  T  =  1.  55  seconds  and 
frequency  range  f^  =  28,  5  cps  to  f^^  =  1050  cps,  giving  n  =  3810.  6 
events  per  record.  Sine  wave  present  with  (p/r)  =  1,0. 

From  £q.  (15.  1)  the  sampling  mean  and  variance  for  a  random 
signal  would  be  as  follows: 

p  =  1905.  3  ;  =  952.  4 
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The  acceptance  region  for  testing  at  the  5%  level  of  significance  is 


p.  .  ±  1.  96  cr  =  1905  ±  60 

Then  the  hypothesis  of  randomness  will  be  accepted  if  the  number  of 
zero  crossings  in  a  sample  record  is 

1845sL/q  *  1965 

The  probability  of  a  Type  II  error  for  the  test  is  P  =  0.  05  for  detecting 
a  difference  of  6.  3%  in  the  expected  number  of  zero  crossings. 

From  Table  12.  3,  the  total  number  of  zero  crossings  for  each 
experiment  (T  =  1.  55  seconds)  are  as  follows; 


Test  Procedure  C-1 
Test  Procedure  C-2 
Test  Procedure  C-3 
Test  Procedure  C-4 


(fQ  =  200  cps)  ; 
(fQ  =  400  cps)  ; 
{{q  =  600  cps)  ; 
(Iq  =  800  cps)  ; 


=  1817  crossings 
=  1993  crossings 
=  2080  crossings 
=  2188  crossings 


Then  the  randomness  hypothesis  would  be  correctly  rejected  for  all 
four  sample  records  tested. 


C-5  through  C-9.  Sample  records  with  length  T  =  3.  10  seconds  and 
frequency  range  f^  =  95  cps  to  f^^  =  630  cps,  giving  n  =  4885.  6 
events  per  record.  Sine  wave  present  with  (p/r)  =  0.  25. 

From  Eq.  (15.  1)  the  sampling  mean  and  variance  for  a  random 
signal  would  be  as  follows: 

u  =  2442.8  ;  ir,,  =1221,1 

H)  ^0 

The  acceptance  region  for  testing  at  the  5%  level  of  significance  is 

P,,  ±1.  96cr  =  2443  ±  68 
l/Q  ^0 

Then  the  hypothesis  of  randomness  will  be  accepted  if  the  number  of 
zero  crossings  in  a  sample  record  is 

2375s  2511 
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The  probability  of  a  Type  II  error  for  the  test  is  (3  =  0.  05  for  detecting 
a  difference  of  5.  6%  in  the  expected  number  of  zero  crossings. 

From  Table  2,  the  total  number  of  zero  crossings  for  each  experi¬ 
ment  (T  =  3.  10  seconds)  are  as  follows: 

Test  Procedure  C-5  (f^  =  150  cps)  ;  =  1849  crossings 

Test  Procedure  C-6  (Iq  =  250  cps)  ;  =  2088  crossings 

Test  Procedure  C-7  (f^  =  350  cps)  ;  =  2410  crossings 

Test  Procedure  C-8  (Iq  =  450  cps)  ;  =  2730  crossings 

Test  Procedure  C-9  {£q  =  550  cps)  ;  =  3184  crossings 

Then,  the  randomness  hypothesis  is  correctly  rejected  for  all  but 
one  of  the  five  sample  records  tested,  and  erroneously  accepted  for  one 
sample  record  (Test  Procedure  C-7). 

The  power  with  which  Random  Test  A  detects  nonrandomness  is 
clearly  shown  by  the  above  illustrations.  A  segment  of  an  amplitude  time 
history  record  used  to  obtain  data  for  the  above  illustrations  is  shown 
in  Figure  15.  7.  A  random  signal  record  is  shown  with  the  nonrandom 
record.  Note  that  the  presence  of  a  periodic  component  is  not  readily 
apparent  from  the  signal  time  history.  This  should  give  greater  apprecia¬ 
tion  for  the  power  with  which  the  test  detects  nonrandomness. 

Consider  now  the  zero  crossings  measured  for  signals  which  are 
random  but  do  not  have  uniform  power  spectra.  This  data  is  designated 
as  Area  B  in  Section  12  and  is  presented  in  Table  12.  2.  Apply  Randomness 
Test  A  to  this  data  (B-1  through  B-4  in  Table  12.  2)  at  the  a  =  0.  05  level 
of  significance. 

B-l  through  B-5.  Sample  records  with  length  T  =  0.  10  seconds  and 
frequency  range  f^  =  95  cps  to  f^^  =  630  cps,  giving  n  =  157.  6l 
events  per  record.  Narrow  peak  present  in  the  power  spectrum 
with  magnitude  of  100:1. 

For  this  case  the  region  of  acceptance  for  testing  a  hypothesis  of 
randomness  is  exactly  the  same  as  for  the  data  under  A-3.  Then,  a 
hypothesis  of  randomness  will  be  accepted  at  the  5%  level  of  significance  if 
the  number  of  zero  crossings  in  a  sample  record  is 

67- 91 
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From  Table  12.  2,  for  a  narrow  peak  in  the  power  spectrum  at  150  cps 
(Test  Procedure  B-1),  the  hypothesis  of  randomness  would  be  accepted  for 
only  five  sample  records  (Samples  No.  1,  3,  8,  24,  and  29),  and  would  be 
erroneously  rejected  for  the  remaining  26  sample  records. 

For  a  narrow  peak  in  the  power  spectrum  at  350  cps  (Test  Procedure 
B-2),  the  hypothesis  of  randomness  would  be  accepted  for  all  31  sample 
records.  For  this  case,  the  actual  sampling  mean  is  not  very  different 
from  that  predicted  by  Eq.  (15.  1),  while  the  actual  sampling  variance  is 
much  less  than  predicted  by  Eq.  ( 15.  1). 

For  a  narrow  peak  in  the  power  spectrum  at  550  cps  (Test  Procedure 
B-3),  the  hypothesis  of  randomness  would  be  erroneously  rejected  for  all 
31  sample  records.  Here  the  actual  sampling  mean  is  quite  different  from 
that  predicted  by  Eq.  (15.  1). 

For  three  narrow  peaks  in  the  power  spectrum  at  150  cps,  350  cps, 
and  550  cps  (Test  Procedure  B-4),  the  hypothesis  of  randomness  would  be 
accepted  for  17  sample  records  (Samples  No.  1,  2,  4,  5,  6,  9,  10,  11,  12, 

14,  15,  19,  20,  24,  25,  27,  and  28),  and  erroneously  rejected  for  the 
remaining  14  sample  records. 

It  is  clear  from  the  above  analysis  that  Randomness  Test  A  does  not 
correctly  detect  randomness  in  signals  which  do  not  have  reasonably 
uniform  power  spectra. 

15.  5.  2  Randomness  Test  B 

The  effectiveness  of  Randomness  Test  B  may  be  studied  using 
the  mean  square  value  data  presented  in  Section  15.  4.  Apply  Randomness 
Test  B  to  each  collection  of  6 1  mean  square  values  gathered  for  the  five 
different  signals  (Experiments  1  through  5  in  Table  15.  2)  at  the  a  =  0.  05 
level  of  significance. 

If  it  is  hypothesized  that  the  mean  square  values  were  measured 
from  a  random  signal,  from  Eq.  (15.  26)  for  N  =  61  and  a  =  0.  05,  the 
region  of  acceptance  for  the  hypothesis  is 

—  r  0.  71 
2 
c 
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2 

From  Eq.  (15.  18),  ~  0.056.  Thus,  the  hypothesis  will  be  accepted  at 

the  5%  level  of  significance  if  the  normalized  variance  for  the  measured 
mean  square  values  is 

*  0.  040 


From  Figure  6.  19  of  Ref.  3  ,  the  probability  of  a  Type  II  error  for  the 

i  J  2  2 

test  is  P  =  0.  05  for  detecting  a  true  value  of  £  =0.55  £  ^  =  0.  0308. 

The  normalized  variance  for  each  of  the  five  collections  of  mean 
square  values  is  presented  in  Table  15.  4.  The  results  of  the  randomness 
t'  st  are  as  follows. 


1.  (p/r)  =  0 

2.  (p/r)  =  1 

3.  (p/r)  =  2 

4.  (p/r)  =  4 

5.  (p/r)  =  9 


€ ^  =  0.  045  ; 

£  ^  =  0.  047  ; 

£  ^  =  0.  032  ; 

=  0.  016  ; 
€  ^  =  0.  0093  ; 


accepted 

accepted 

rejected 

rejected 

rejected 


The  first  experiment  involves  a  signal  which  is  truly  random,  so 

the  acceptance  is  proper.  The  second  experiment  involves  a  nonrandom 

signal  with  a  (p/r)  ratio  of  unity.  Thus,  the  acceptance  here  constitutes 

a  Type  II  error.  Note  that  the  expected  value  of  the  normalized  variance 

2  2 

for  (p/r)  =  1  is  £  =  0.  042  =  0.  75£^  .  The  probability  of  making  a 

Type  II  error  for  this  case  is  P  Ri  0.  6  or  60%.  Hence,  the  occurrence 
of  a  Type  II  error  for  this  case  is  not  surprising.  The  last  three  experi¬ 
ments  involve  nonrandom  signals  with  (p/r)  ratios  from  2  to  9.  In  all 
three  cases,  the  hypothesis  of  randomness  is  correctly  rejected. 


15.  5.  3  Relative  Effectiveness  of  Randomness  Tests 

It  is  clear  from  the  discussions  in  Section  15.  5.  1  that  Random¬ 
ness  Test  A  is  exceptionally  powerful  under  ideal  conditions.  The  test 
detected  a  sine  wave  in  a  random  signal  with  a  (p/r)  ratio  of  only  0.  25 
using  a  sample  record  length  of  only  3.  10  seconds.  Randomness  Test  B 
failed  to  detect  a  sine  wave  in  a  random  signal  with  a  (p/r)  ratio  of  unity 
from  61  mean  square  values  representing  a  total  sample  record  length  of 
19.  5  seconds. 

On  the  other  hand.  Randomness  Test  A  may  erroneously  reject  a 
random  signal  as  being  nonrandom  if  a  sharp  peak  is  present  in  the  power 
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spectrum.  In  other  words,  Test  A  is  unable  to  distinguish  between  sine 
waves  and  narrow  band  random  signals.  This  is  understandable  since 
the  test  is  based  upon  zero  crossing  information.  A  sine  wave  in  an  other¬ 
wise  random  signal  and  a  sharp  peak  in  tlie  power  spectrum  of  a  random 
signal  both  tend  to  affect  the  resulting  zero  crossings  in  a  similar  manrer. 
Thus,  the  only  way  Randomness  Test  A  could  be  effectively  used  is  to 
observe  the  power  spectrum  for  the  signal  to  be  investigated,  and  apply 
the  test  to  a  frequency  range  where  no  sharp  peaks  are  observed. 

However,  as  discussed  in  Section  15.  1.  1,  if  no  distinct  peaks  are  present 
in  a  properly  resolved  power  spectrum,  no  periodic  components  could  be 
present  and  further  tests  for  randomness  are  unnecessary.  Because 
narrow  band  random  vibration  responses  are  common  for  lightly  damped 
flight  vehicle  structures,  Randomness  Test  A  does  not  appear  to  be 
practical  for  applications  to  flight  vehicle  vibration  data. 

Randomness  Test  B  does  not  pose  the  problem  discussed  above.  The 
theory  of  Test  B  is  not  dependent  upon  the  shape  of  the  power  spectrum 
for  the  signal  as  long  as  an  equivalent  ideal  bandwidth  for  the  signal  can 
be  defined.  In  fact.  Test  B  is  most  powerful  when  applied  only  to  the 
narrow  frequency  range  of  sharp  peaks  observed  in  the  power  spectrum. 

In  summary,  although  Randomness  Test  A  is  more  powerful  than 
Randomness  Test  B  under  ideal  conditions.  Test  A  is  considered  im¬ 
practical  for  applications  to  flight  vehicle  vibration  data  analysis. 


ASD  TDR  62-973 


15-35 


15.6  CONCLUSIONS 

Two  different  procedures  for  testing  single  sample  records 
for  randomness  have  been  experimentally  evaluated.  One  of  the  pro¬ 
cedures  (Test  A)  is  the  randomness  test  originally  proposed  in  Section 
6.  1.  5  of  Ref.  ^ij.  The  second  procedure  (Test  B)  is  based  upon  more 
recent  concepts  developed  herein. 

The  experimental  results  confirm  the  validity  of  the  theory  for 
Randomness  Test  A,  as  developed  in  Ref.  [ij-  However,  the  results 
also  indicate  Test  A  will  erroneously  reject  random  signals  as  being  non- 
random  unless  the  power  spectra  of  the  signals  are  reasonably  uniform. 
This  fact  makes  the  application  of  Test  A  to  flight  vehicle  vibration 
response  data  impractical,  since  such  data  rarely  have  uniform  power 
spectra.  Randomness  Test  B  proposed  in  this  section  does  not  present 
the  above  problem.  Although  Test  B  is  less  powerful,  rts  application 
to  flight  vehicle  vibration  data  is  more  practical.  Thus,  it  is 
recommended  that  Randomness  Test  A  from  Ref.  ^ij  be  dropped  in  favor 
of  the  new  test  for  randomness  presented  herein. 

Qualitative  techniques  for  evaluating  the  randomness  of  flight 
vehicle  vibration  data  are  also  discussed.  These  techniques  involve 
observation  of  certain  distinguishing  details  in  power  spectral  density 
functions,  autocorrelation  functions,  and  amplitude  probability  density 
functions.  These  qualitative  procedures  will  often  reveal  periodicities 
in  an  otherwise  random  vibration  without  the  need  for  quantitative  testing 
of  the  data. 
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16.  TESTS  FOR  STATION ARITY 


16.  1  THEORY  OF  TESTS  FOR  STATIONARITY 
16.  1.  1  General  Remarks 

The  general  requirements  for  stationarity  of  a  collection  of 
random  signal  records  forming  a  random  process  are  discussed  in 
Section  6.  1.  6  of  Ref.  ^  1  j.  As  noted  there,  the  term  "stationary"  usually 
applies  to  the  properties  of  a  collection  (ensemble)  of  random  signals 
determined  by  taking  ensemble  averages  at  specific  times.  However,  the 
concept  of  stationarity  may  also  be  applied  to  the  properties  of  a  single 
random  signal  (assumed  to  exist  over  all  time)  determined  by  taking  time 
averages  over  different  time  intervals.  This  concept  of  stationarity  is 
called  "self- stationarity"  to  distinguish  it  from  the  general  concept  of 
stationarity  for  an  ensemble  of  random  signals  forming  a  random  process. 

For  a  single  random  signal,  if  the  mean  values,  mean  square  value 
and  autocorrelation  functions  determined  by  taking  time  averages  over 
different  time  intervals  are  statistically  equivalent,  the  random  signal  is 
considered  "weakly  self- stationary.  "  For  a  random  signal  representing 
a  vibration  response,  the  mean  value  (DC  component)  is  usually  zero. 
Furthermore,  if  the  mean  square  values  are  equivalent,  there  is  strong 
reason  to  believe  that  the  autocorrelation  functions  are  similar  since  auto¬ 
correlation  functions  are  less  than  or  equal  to  their  associated  mean 
square  values.  Hence,  the  determination  of  weak  self- stationarity  for 
random  vibration  signals  can  usually  be  limited  to  an  examination  of  mean 
square  levels.  These  matters  are  discussed  in  more  detail  in  Section 
6.  1.  6  of  Ref.  ^  ij. 

For  simplicity  in  the  present  study,  the  term  "stationary"  will  be 
used  throughout  the  discussions  where  it  is  understood  that  only  mean 
square  values  determined  by  time  averaging  are  considered  (weak 
self-  stationarity). 

A  quantitative  procedure  for  testing  a  single  random  signal  record 
for  stationarity  is  suggested  in  Section  6.  1.  8  of  Ref.  ^  ij.  Experimental 
verification  of  that  test  procedure,  hereafter  referred  to  as  Stationarity 
Test  A,  is  a  major  subject  of  this  section.  Two  other  alternative  tests 
for  stationarity  are  also  developed  here  and  studied  experimentally. 
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One  of  these  alternative  tests  involves  a  simple  chi-squared  test  of  vari¬ 
ances,  and  will  hereafter  be  referred  to  as  Stationarity  Test  B.  The 
second  alternate  test  makes  use  of  the  F  statistic  to  test  the  maxi- 

TTltitX 

mum  and  minimum  of  a  group  of  mean  square  estimates,  and  will 
hereaifter  be  referred  to  as  Stationarity  Test  C.  These  three  tests  are 
discussed  in  Sections  16.  1.  2  through  16.  1. 4. 

All  three  procedures  test  for  the  same  basic  characteristic; 
namely,  the  equivalence  of  a  collection  of  mean  square  estimates.  The 
collection  may  consist  of  the  mean  square  values  of  sample  records  ob¬ 
tained  from  different  random  signals,  or  sample  records  obtained  at 
different  times  from  the  same  random  signal,  or  sample  records  obtained 
by  dividing  a  single  sample  record  into  several  subrecords.  The  practical 
applications  represented  by  these  various  cases  are  discussed  later  in 
Section  16.  1 .  5. 


16.  1.  2  Review  of  Stationarity  Test  A 

The  following  discussion  is  a  review  of  Section  6.  1.  8  of  Ref.  |lj. 
Consider  a  stationary  random  signal  x;(t)  which  hypothetically  exists  over 
all  time.  Let  the  mean  value  of  x(t)  be  zero,  and  the  mean  square  value 
of  x(t)  be  .  Assume  a  long  sample  amplitude  time  history  record  of 
length  T  is  obtained  which  is  then  divided  into  N  number  of  subrecords, 
each  of  equal  length  T^  =Cr/N)^  as  shown  in  Figure  16.  1. 

2  ^ 

For  each  of  the  subrecords,  a  mean  square  value  x^ 

2 

(i  =  1,  2,  3,  ....  N)  is  measured.  Each  value  x^  will  be  an  estimate  of 

2 

the  true  mean  square  value  <r^  for  the  signal.  That  is. 


E 


(16.  1) 


The  mean  square  value  of  subrecords  is  denoted  by  s  in  Section  6.  1.  8 
of  Ref.  [l].  The  term  x^  is  used  here  to  avoid  confusion  with  the 

experimental  sample  variance  denoted  by  s  later  in  this  section. 
Furthermore,  a  number  of  subscripts  are  used  here  for  additional 
clarity  which  were  not  used  in  Section  6.  1.  8  of  Ref.  [^l]. 
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amplitude 


Figure  16.  I  Sample  Amplitude  Time  History  Record 


Assuming  x(t)  is  distributed  in  an  approximately  Gaussian  manner, 

~2 

the  sampling  distribution  for  the  values  x^  will  be  associated  with  a  chi- 
squared  distribution  as  follows. 

n  =  2BTj  (16.  2) 

where  means  'distributed  as",  and  x~  is  a  chi-squared  distribution 

with  (n  -  1)  degrees  of  freedom.  The  term  n  is  the  equivalent  number  of 
events  represented  by  each  subrecord.  The  bandwidth  B  is  an  equivalent 
ideal  bandwidth  with  infinitely  sharp  cutoffs. 
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From  Eq.  (16.  2),  a  probability  statement  concerning  the  expected 

values  for  x.  can  be  made  as  follows. 

1 


Prob 


2  2 
<r  X 


2  2 


X  ^(l-a/2.) 
(n-1) 


-  *i  = 


(n-  1) 


=  ( 1  -  Q)  =  p 


The  meaning  of  Eq.  (16.  3)  is  as  follows.  If  x(t)  is  stationary  over  the 

2 

sample  record  of  length  T,  the  probability  is  p  that  the  value  x^ 

measured  from  each  of  the  N  number  of  subrecords  will  fall  within 

the  noted  interval,  or  the  probability  is  ( 1  -  p)  that  the  value  will  fall 

outside  the  noted  interval.  _ 

2 

Now,  consider  each  measurement  x^  as  an  experiment  where  N 
number  of  experiments  are  performed.  Each  experiment  has  two  possible 

outcomes:  the  value  _ will  fall  outside  the  p  probability  interval 

(a  failure),  or  the  value  x^^  will  fall  inside  the  p  probability  interval 
(a  success).  Assuming  the  series  of  N  number  of  experiments  are 
statistically  independent,  the  set  of  experiments  may  be  considered  as  a 
set  of  Bernoulli  trials  where  the  probability  of  a  success  is  p  and  the 
probability  of  a  failure  is  (1  -p). 

Let  q  be  the  number  of  failures.  The  sampling  distribution  for 
the  number  of  failures  in  a  finite  number  of  experiments,  N,  is  given  by 
a  binomial  distribution  as  follows: 

b(q)  =  ^^j(I  -P)‘^(P)^’‘*  (16.4) 

where 

\q/  qi  (N-q): 


From  Eq.  (16.  4),  if  the  signal  x(t)  is  stationary,  the  probability 
of  actually  obtaining  up  to  k  number  of  failures  (values  of  x^  which 
fall  outside  the  desired  probability  interval)  is  given  by 

k 

Prob(q<k)=  ^  j  ( 1  -  P)^(p)^’‘^  (16.5) 


The  term  p  is  used  here  instead  of  (1-a)  to  avoid  confusion  with  the  usual 
concept  of  (1-a)  =  confidence  coefficient. 
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The  mean  and  variance  for  the  binomial  distribution  in  Eq.  (16.  4) 
is  given  by 


=  (1  -  p)N 
=  (1  -  P)pN 


(16.6) 


For  those  cases  where  (1  -  p)N  is  relatively  large,  say  greater  than  10, 
the  binomial  distribution  may  be  approximated  by  a  normal  distribution 
with  a  mean  and  variance  as  given  in  Eq.  (16.  6). 

From  either  Eq.  (16.  5)  or  Eq.  (16.  6),  a  hypothesis  test  for 
stationarity  can  be  performed  at  any  desired  level  of  significance. 
Further  details  are  presented  in  Section  6.  1.  8  of  Ref.  [l]  • 

Example 

The  above  discussions  will  be  clarified  by  considering  a  specific 
example.  The  example  used  is  an  actual  case  which  is  studied  herein 
experimentally.  Let  the  length  of  the  seunple  record  be  T  =  25  seconds. 
Let  the  number  of  subrecords  formed  from  the  sample  record  be 
N  =  25.  Suppose  the  effective  bandwidth  of  the  signal  is  B  =  56  cps. 

Let  the  true  mean  square  value  of  the  signal,  ,  be  arbitrary.  For 
this  example, 

=(T/N)=  (25/25)=  1  second 
n  =  2bTj  =  2(56)  =  112 

and  Eq.  (16.  3)  becomes 


Prob 


^(1-0/2)°' 

111 


2 

X 


2 


111 


=  P 


(16.  7) 


Let  p  =  (1  -  p)  =  0.  5;  that  is,  a  50%  probability.  From  Table  A-6b 
of  Ref.  [  2]  (noting  that  "percentiles"  in  this  table  are  1  -  p), 


=0.905 

(0.75) 

2 

X  =1.09 

(0.25) 
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Then,  Eq.  (16.  7)  reduces  to 


Prob 


0.  905a  ^ 

X 


1. 09  a  ^ 

X 


0.  50 


(16.8) 


From  Eq.  (16.  8),  if  the  signal  x(t)  is  stationary  over  the  sample  record, 

2 

the  probability  is  p  =  0.  50  that  a  value  x^  will  fall  inside  the  stated 
limits  (a  success),  and  (1  -  p)  =  0.  50  that  a  value  will  fall  outside 
the  stated  limits  (a  failure). 

Now  consider  the  sampling  distribution  for  the  number  of  failures 
q.  From  Eq.  (16.  6),  the  mean  and  variance  are  given  by 


=  (1  -p)N  12.  5 

2  (16.9) 

a^  =  ( 1  -  p)  pN  =  6.  25 

Thus,  for  the  25  values  for  x^^  (i  =  1  to  25),  the  expected  number  of 
failures  (values  less  than  0.905a^  or  greater  than  1.09a^)  is  12.  5.  The 
sampling  variance  is  6.  25.  If  the  signal  x(t)  were  not  stationary  over 
the  record  length  T  =  25  seconds,  the  expected  number  of  failures 
would  obviously  be  greater.  Thus,  to  test  a  hypothesis  of  stationarity, 
a  one-sided  test  is  used. 

For  the  present  example,  let  it  be  hypothesized  that  x(t)  is 
stationary  over  the  record  of  length  T  =  25  seconds.  This  hypothesis 
will  now  be  tested  at  the  5%  level  of  significance.  From  Table  A-4  of 
Ref.  ^2j,  for  an  a  =  0.05  level  of  significance,  and  a  normad  distri¬ 
bution  for  q,  the  following  probability  exists 


Prob 


q  (Kq  + 


1.  65a  ) 

q 


=  0.  95 


(16.  10) 


Thus,  the  region  of  acceptance  for  the  hypothesis  test  is 


q  2  16.6  25,  or  q  17  (16.  11) 

2 

For  the  25  mean  square  estimates,  x.  ,  if  16  or  fewer  fall  within 
2  2  ^ 

the  interval  (0.905a^  ,  1.09a^  ),  the  hypothesis  of  stationarity  is 
accepted.  If  17  or  more  fall  outside  the  noted  interval,  the  hypothesis 
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of  stationarity  is  rejected  with  a  Type  I  error  of  5%.  That  is,  the 
signal  x(t)  is  considered  nonstationary  over  the  record  length  of 
T  =  25  seconds  with  a  probability  of  5%  that  this  conclusion  is  an  error. 

Since  the  possible  conditions  of  noiistationarity  are  undefined,  a  quan¬ 
titative  Type  II  error  for  the  test  is  not  really  meaningful.  However,  in 
qualitative  terms,  when  the  test  is  applied  at  any  given  level  of  significance 
to  a  nonstationary  signal,  the  Type  II  error  will  go  down  as  the  values  of 
n  and/or  N  are  increased. 

The  application  of  this  test  for  stationarity  (Test  A)  to  actual 

vibration  data  poses  one  major  problem.  The  true  mean  square  value 

of  the  vibration  response  signal  <r  ^  will  be  an  unknown  quantity.  It  is 

^  2 

thus  necessary  in  practice  to  replace  a  with  the  best  available  esti-  _ 

^  2 

mate.  The  best  available  estimate  is  obviously  the  mean  square  value  x 
for  the  entire  record  of  length  T.  That  is. 

T  ^ _ 

x^{t)  dt  =  ^  12) 

It  is  shown  in  Section  13.  5.  3  that  Eq.  (16.  12)  should  yield  acceptable 
results  if  2BT^  40N(2BTj  »  40). 

16.  1.  3  Principles  of  Stationarity  Test  B 

The  second  test  for  stationarity  to  be  discussed  here  is  somewhat 

simpler  in  concept  than  Test  A  discussed  in  Section  16,  1.  2.  As  before, 

consider  a  stationary  random  signal  x(t)  with  a  mean  value  of  zero  and 

a  mean  square  value  of  .  Assume  a  sample  amplitude  time  history 

record  of  length  T  is  obtained  and  divided  into  N  number  of  subrecords, 

each  of  equal  length  T  =(T/N)  as  shown  in  Figure  16.  1.  For  each  of  the 

1  2 

subrecords,  a  mean  square  value  x.  (i  =  1 , 2,  3,  .  .  .  ,  N)  is  measured. 

2  ^  2 

Each  value  of  x^  will  be  an  estimate  of  as  given  by  Eq.  (16.  1). 
Assuming  x(t)  is  distributed  in  an  approximately  Gaussian  manner,  the 
sampling  distribution  for  the  values  x.  will  be  as  given  by  Eq.  (16.  2). 
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It  is  proved  in  Section  13.  5.  2  that  for  stationary  records  the  normalized 
variance  of  the  mean  square  values  can  be  described  theoretically  as 
follows. 


2 

( 


Var(  x.^ )  j 

i  «5T“ 

(ff  )  ^ 

'  X 


(16.  13) 


Given  the  set  of  N  number  of  values  x.  ,  a  variance  for  the  values  can 

^  2 

be  estimated  by  calculating  the  sample  variance  s  as  follows. 


-  N4<’‘i  -  *  >  = 

1=1  i=l 


f )  ^  -  ( A  ^ 


(16.  14) 


Here,  x  is  the  average  mean  square  value  given  by  Eq.  (16.  12). 

From  Eq.  (16.  14),  an  estimate  for  the  normalized  variance  of  the  values 

X.  will  be 
1 

) 

'  X 


2 

The  term  «  is  simply  a  variance  estimate  and  will  thus  have  a  sampling 
distribution  associated  with  a  chi- squared  distribution  as  follows. 


(16.  16) 


where  means  "distributed  as"  and  x  is  chi- squared  with  (N  -  1) 

degrees  of  freedom.  The  practical  validity  of  Eq.  (16.  16)  is  experimentally 
substantiated  in  Section  13. 

In  Eq.  (16.  16),  if  the  signal  x(t)  is  stationary,  the  measured  variance 
^2  2 

c  and  the  theoretical  variance  c  should  be  equivalent.  Then,  a  hypothesis 
of  stationarity  is  established  by  the  null  hypothesis  as  follows. 

9{(  2 

A  biased  expression  for  s  is  employed  here  so  that  all  statistical  ,  .. 
procedures  to  follow  will  be  consistent  with  procedures  outlined  in  Ref.  1  . 
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(16.  17) 


H 


o 


a2 
;  < 


2 

c 


If  x(t)  is  nonstationary  over  the  record  of  length  T,  the  variance  of  the 

1  2 
values  would  be  greater  than  predicted  by  <  .  Thus,  a  one-sided 

test  of  is  used.  More  specifically,  if  is  tested  at  the  a  level 

of  significance,  the  region  of  acceptance  is  given  by 


c 


(16.  18) 


A  plot  of  the  acceptance  regions  of  the  normalized  variance  ratio  for 
various  values  of  a  and  N  is  shown  in  Figure  16.  2. 

For  clarity,  consider  the  above  discussion  in  terms  of  the  same 
example  used  in  Section  16.  1.  1.  That  is, 


T  =  25  seconds 
N  =  25 
B  =  56  cps 
Tj  =  1  second 

€  —  *  0.0178 


Let  it  be  hypothesized  that  x(t)  is  stationary  over  the  record  of 

/\  z  z 

length  T  =  25  seconds;  that  is,  :  «  =  «  This  null  hypothesis  will 

now  be  tested  at  the  5%  level  of  significance.  From  Table  A-6a  of 

14  Xo  os  "  ■'  nine  degrees  of  freedom,  and  the  following 

probability  exists. 


f^2  _  (36,4)(0.  0178) 

=  p  0.  0259 

1  25 

L 

0.95  (16.19) 


Then  the  region  of  acceptance  for  the  null  hypothesis  is 

0.  0259  (16.  20) 

where  is  computed  using  Eqs.  (16.  14)  and  (16.  15).  If  the  computed 
A  Z 

value  for  c  ^  is  less  than  0.  0259,  the  hypothesis  of  stationarity  is 
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Figure  16.  2  Acceptance  Regions  for  Stationarity  Test  B 


accepted,  If  is  greater  than  0.0259,  the  hypothesis  of  stationarity 
is  rejected  with  a  Type  I  error  probability  of  5%.  That  is,  the  signal 
x(t)  is  considered  nonstationary  over  the  record  length  of  T  =  25  seconds 
with  a  probability  of  5%  that  this  decision  is  an  error. 

As  in  Test  A,  there  is  no  meaningful  Type  II  error  probability,  P  , 
because  there  is  no  quantitative  definition  for  all  of  the  possible  con¬ 
ditions  of  nonstationarity.  For  this  test,  however,  a  fictitious  Type  II 
error  can  be  defined  in  terms  of  deviations  in  the  ratio  e[*^]/€^  , 

The  Operating  Characteristic  (OC)  curves  for  this  case  are  given  for 
a  =  0,  05  and  0.  01  in  Figures  6.  17  and  6.  18  of  Ref.  [2].  The  number  of 
records  N  needed  to  detect  a  nonstationarity  as  measured  by  | 

with  a  probability  P  may  be  selected  from  the  appropriate  OC  curves. 

In  general,  the  Type  II  error  will  go  down  as  the  value  of  N  is 
increased. 


The  application  of  this  test  for  stationarity  (Test  B)  to  actual  vibration 

data  poses  the  same  problem  discussed  in  Section  6.  1.  1  for  Test  A.  The 

2 

true  mean  square  level  of  the  vibration  response  signal  (t  ,  needed  to 

z  ^ 

compute  «  from  Eq.  (16.  15),  will  be  an  unknown  quantity.  For  practical 

2  ~~2 

applications  it  is  necessary  to  replace  by  the  mean  square  value  x 
computed  for  the  entire  record  of  length  T,  as  shown  in  Eq.  (16.  12). 

This  substitution  is  acceptable  if  2BTg  **  40. 


16.  1.  4  Principles  of  Stationarity  Test  C 

The  third  test  for  stationarity  to  be  discussed  here  is  simplest  in 
terms  of  practical  applications  of  the  three  procedures  presented.  As 
before,  consider  a  stationary  random  signal  x(t)  with  a  mean  value  of 
zero  and  a  mean  square  value  of  .  Assume  a  sample  amplitude 
time  history  record  of  length  T  is  obtained  and  divided  into  N  number 
of  subrecords,  each  of  equal  length  T^  =(t/N)^  as  shown  in  Figure  16.1. 
For  each  of  the  subrecords,  a  mean  square  value  'x^  (i  =  1,  2,  3,  .  .  .  ,  N) 

"7  '2 

is  measured.  Each  value  x.  will  be  an  estimate  of  c  based  on 

1  X 

n  =  2BT.  equivalent  number  of  events.  _ 

1  2 

Now,  select  from  the  N  number  of  values  x^  the  maximum  value 
I’^ax  the  minimum  value  (x^j^  .  Assuming  x(t)  is  distributed 
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in  an  approximately  Gaussian  manner,  the  ratio  of  these  two  values  will 

be  distributed  as  the  statistic  F  .  That  is, 

max 


(?) 


max 


(?)  . 

mm 


max 


(16.  21) 


where  means  "distributed  as"  and  F  is  an  F  distribution 

max  max 

for  N  number  of  mean  square  estimates,  each  with  (n  -  1)  degrees  of 
freedom. 

In  Eq.  (16.2ti),  if  the  signal  x{t)  is  stationary,  the  measured  value 

{  x^)  and  (  x^  .  should  be  equivalent.  Then,  a  hypothesis  of  stationarity 
max  min 

is  established  by  the  null  hypothesis  as  follows 


max 


min 


(16.  22) 


If  is  tested  at  the  a  level  of  significance,  the  region  of  acceptance 
is  given  by  _ 


max 

min 


F 

max  ;  a 


(16.  23) 


where  F  for  a  =  0.  01  and  0.  05  are  tabulated  in  Table  5.  7  of 

[max 

1  1.  A  plot  of  the  acceptance  regions  of  the  max-min  mean  square 

ratio  for  various  values  of  n  and  N  is  shown  in  Figure  16.  3. 

The  obvious  advantage  of  Test  C  is  its  simplicity  of  application. 

Only  one  division  of  the  maximum  and  minimum  mean  square  estimates 

is  required.  There  are  two  possible  disadvantages  to  the  test.  First, 

the  F  statistic  has  not  been  studied  in  great  detail  and  only  limited 
max  ®  ’ 

tables  of  F  values  are  available.  Second,  the  power  of  the  test 

max  ;  a 

is  probably  less  than  for  other  procedures  which  employ  all  available 
mean  square  estimates  to  make  decisions.  The  latter  problem  will  be 
considered  in  some  detail  by  the  experiments  performed  herein. 
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16.  3  Acceptance  Regions  for  Stationarity  Test  C 


16.  1.  5  Bandwidth  and  Averaging  Time  Considerations 


Each  of  the  three  tests  for  stationarity  proposed  here  is  applicable 
to  any  collection  of  mean  square  estimates  which  one  wishes  to  test  for 
equivalence.  However,  for  all  three  tests,  it  is  required  that  the  mean 
square  estimates  each  represent  an  equal  number  of  events  n,  and  that 
the  value  of  n  is  known.  From  Eq.  (16.  2),  n  is  a  function  of  the  signal 
bandwidth  B  and  the  record  length  (averaging  time)  Tj  for  each  record 
of  the  collection.  Bandwidth  and  averaging  time  considerations  are 
discussed  in  Section  13.  1.  3.  However,  some  additional  discussion  is 
warranted  here. 

a)  Bandwidth  Considerations 

If  a  random  signal  x(t)  with  a  uniform  pow'er  spectrum,  G(f)  = 
constant,  is  filtered  with  infinitely  sharp  cutoffs  between  any  two 
frequencies  f^  and  f^,  the  bandwidth  of  the  signal,  B  =  f -  f^  ,  is 
ideally  defined.  Given  a  real  filter  with  a  constant  parameter  linear 
frequency  response  function  H(f),  an  equivalent  ideal  bandwidth  for  the 
filter  is  given  by 


B  =  B 


N 


(H  y 
max 


df 


(16.  24) 


For  stationary  signals,  the  power  spectral  density  function  for 
the  response,  G^(f),  is  associated  with  the  power  spectral  density  func¬ 
tion  for  the  excitation,  G  (f),  as  follows. 

e 

G^{f)  =  |H(f)|^  Gjf)  (16.  25) 


For  most  practical  purposes,  the  power  spectrum  for  a  vibration 
response  may  be  considered  the  result  of  linear  filtering  of  an  excitation 
with  a  uniform  power  spectrum,  Gg(^)  =  constant.  Then,  upon  substitution 
of  Eq.  (16.  25)  into  Eq.  (16.  24),  the  following  result  is  obtained. 


X  max 


c^(f)  d£  = 


X  max 


(16.  26) 
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In  words,  Eq.  (16.  26)  states  that  the  equivalent  ideal  bandwidth  for 
a  random  signal  representing  a  vibration  response  x(t),  is  given  by  the 
mean  square  value  divided  by  the  peak  value  of  the  power  spectrum. 

“7  A 

Thus,  given  the  estimates  x  for  the  meajn  square  value  and  G(f)  for 
the  power  spectrum,  the  equivalent  ideal  bandwidth  for  a  random  signal 
can  be  estimated  from  the  ratio  x 

•  max 

b)  Averaging  Considerations 

The  ideal  method  of  averaging  is  by  linear  integration  over  the 
record  length  T.  For  the  problem  at  hand,  the  mean  square  values  of 
the  subrecords  should  be  determined  by  linear  integration  over  each  of 
the  record  lengths  T^  .  However,  averaging  is  often  accomplished  by 
continuous  smoothing  with  a  low  pass  RC  filter  having  a  time  constant  K. 
The  general  associations  between  the  time  constant  K  and  the  equivalent 
averaging  time  T^  are  discussed  in  Section  13.  1.  3.  There  are  special 
considerations  which  apply  to  the  present  problem. 

Assume  a  long  record  of  length  T  is  to  be  tested  for  stationarity 
by  analysis  of  a  continuous  RC  averaged  mean  square  estimate  as 
shown  in  Figure  16.  4. 


Figure  16.  4  Analysis  of  Continuous  Mean  Square  Levels 
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Let  the  time  constant  K  be  short  as  compared  to  T;  that  is, 

Now  divide  the  continuous  mean  square  estimate  into  N  equal 
intervals  such  that  each  interval  is  about  3K  or  4K  long.  The  level  of 
the  continuous  mean  square  estimate  at  the  end  of  each  interval  will 
constitute  a  mean  square  measurement  based  on  an  equivalent 
averaging  time  of  =  2K.  The  individual  readings  should  be 

3K  or  4K  apart  to  assure  that  they  are  statistically  independent.  Note 
that  the  points  at  which  readings  are  made  can  also  be  selected  by 
random  sampling.  Under  no  circumstances,  however,  should  the  points 
be  selected  without  a  pre -designated  plan  (equal  intervals  or  random 
intervals).  Otherwise,  the  person  reducing  the  data  may  bias  the 
results. 

16.  2  DESIGN  OF  EXPERIMENTS  AND  PROCEDURES 
16.2.1  General  Design  and  Procedures 

The  general  purpose  of  these  experiments  is  twofold.  The  first 
objective  is  to  experimentally  verify  the  theoretical  foundation  for 
Stationarity  Test  A.  The  foundation  for  Stationarity  Tests  B  and  C  is 
based  directly  on  the  theoretically  expected  variability  of  mean  square 
estimates,  which  is  studied  and  substantiated  by  experiments  in  Section 
13.  The  second  objective  is  to  empirically  compare  the  effectiveness 
or  power  of  the  three  tests  by  applying  them  to  data  obtained  from  a 
signal  record  with  a  known  nonstationary  characteristic. 

16.  2.2  Procedures  for  Verifying  Stationarity  Test  A 

The  objective  is  to  confirm  the  validity  of  Eq.  (16.  4),  which  is  the 

basis  for  establishing  an  acceptance  region  for  the  test  of  a  stationary 

2 

hypothesis.  Given  a  collection  of  N  mean  square  estimates  and  a  X 
probability  interval  of  p  probability,  Eq.  (16.4)  defines  the  sampling 
distribution  for  the  number  q  of  the  N  estimates  which  will  fall  out¬ 
side  the  interval  (the  number  of  failures).  The  sampling  distribution 
is  ideally  a  binomial  distribution  with  a  mean  value  and  variance  as 
follows. 

p^  =  (l-p)N  (16.27a) 

=  (I  -  p)  pN  (16.  27b) 
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The  verification  procedure  is  to  apply  the  Stationarity  Test  A  to 
a  collection  of  N  mean  square  estimates  from  a  stationary  random 
signal,  and  determine  the  number  of  failures  q.  The  experiment  is 
repeated  M  number  of  times  to  obtain  a  collection  of  M  number  of 
experimental  values  for  q.  A  sample  mean  and  variance  for  q  are 
computed  as  follows. 


(16.  28a) 


(16.  28b) 


The  expected  values  for  the  above  sample  mean  and  variance  are  as 
follows. 


E 

E 


(16.  29a) 
(16.  29b) 


The  sample  mean  q  will  be  distributed  as  follows. 


(q  -  p  )  ^  Llll  (16.  30a) 

M  -  1 

where  "t"  is  a  student's  "t"  distribution  with  (M  -  1)  degrees  of  freedom. 
The  sample  variance  s  will  be  distributed  as  follows. 

2  2 

-i- - ^  (16.  3Qb) 

0-  ^  M 

q 

2 

where  x  (M  -  1)  degrees  of  freedom.  Equations  (16.  30a)  and 

2 

( 16.  30b)  permit  the  experimentally  determined  values  for  p  and  <r  , 

_  2  q  q 

as  given  by  q  and  s  ,  to  be  tested  for  equivalence  to  the  theoretical 

2 

values  for  p^  and  o-^  ,  as  given  by  Eq.  (16.  27).  The  existence  of 

equivalence  will  be  considered  as  confirmation  of  the  general  form  of 
Eq.  (16.  4)  and  Stationarity  Test  Procedure  A. 
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More  specifically,  the  Stationanty  Test  A  is  applied  to  a  random 
signal  with  a  bandwidth  of  B  =  56  cps  on  a  center  frequency  of 

~  A  total  of  N  =  25  mean  square  estimates  are  gathered 

by  true  averaging  (linear  integration)  over  consecutive  subrecords, 
each  of  length  =  1  second.  A  x  probability  interval  of  p  =  0.  50 
is  employed,  giving  the  limits  for  a  success  or  failure  as  stated  in 
Eq.  (16.  8).  These  conditions  are  consistent  with  the  numerical  example 
given  in  Section  16.  1.  2.  The  experiment  is  repeated  M  =  31  times. 
Equations  (16.  27)  and  (16,  28)  become 

=  (1  -  0.  5)  25  =  12.  5 
0-^^  =  (1  -  0.  5)0.  5(25)  =  6.  25 


The  hypothesis  of  equivalence  between  the  theoretical  and 
experimental  values  is  tested  at  the  u  =  0.  10  level  of  significance. 
Then,  from  Eqs.  (16.  30),  the  region  of  acceptance  for  the  hypothesis 
of  equivalence  is 


-1.  70  s 
30 


(q  -  Pq)  - 


1.  70  s 
30 


2 

0.596  ^  ^  1.41 

cr 

q 


(16.  31a) 
(16.  31b) 


If  the  31  experimentally  determined  values  for  q  have  a  sample 
mean  and  variance  which  fall  within  the  above  limits,  the  hypothesis 
of  equivalence  vcill  be  accepted,  and  Eq.  (16.  4)  will  be  considered  valid. 

If  the  sample  mean  and  variance  fall  outside  the  noted  limits,  the 
hypothesis  of  equivalence  will  be  rejected,  and  there  will  be  reason  to 
question  the  validity  of  Eq.  (16.  4)  and  the  entire  procedure  for  Stationarity 
Test  A. 
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The  probable  Type  I  and  Type  II  errors  for  the  experiment  are 

Q  =  (3  =  0.  10  for  detecting  a  deviation  of  12%  in  p  =  12.  5  and  a  deviation 

2  ^ 

of  about  2.  4  to  1  in  =  6.  25  (a  deviation  of  approximately  50%  in  tr^). 
These  results  follow  directly  from  the  procedures  for  determining  a 
sample  size  for  equivalence  of  means  and  variances,  as  presented  in 
Section  12.  2.  2.  For  these  experiments,  the  sample  size  of  interest 
is  the  number  of  experiments  M.  Thus,  from  Eq.  (12.19  ),  the 
relationship  between  the  sample  size  M,  the  theoretical  standard 
deviation  a  ,  and  the  mean  value  deviation  Au  which  is  to  be  detected 

q  q 

for  a  =  P  =  0.  10  is  given  by 


M  =  10.  8 


(16.  32) 


Hence,  for  cr  =  2.  5,  the  difference  in  means  is  Au  =  1,  5,  which  is 

q  q 

12%  of  =  12.  5. 

From  Eq.  (12.  22),  the  relationship  between  M  and  the  deviation 

2 

Aor  which  is  to  be  detected  for  a  =  p  =  0.  10  is  given  by 


2*2 
O’  +  Act 

q  q  _ 


^(0.05)  ^  2  4 


’^(O.  95)^^  ■ 


(16.  33) 


for  M  =  31. 

16.  2.3  Generation  of  Nonstationary  Data 

To  perform  some  of  the  experimental  studies  to  follow,  a  labora¬ 
tory  signal  with  a  defined  condition  of  nonstationarity  is  required.  The 
specific  condition  of  nonstationarity  used  is  as  shown  in  Figure  16.  5. 
This  is  obtained  by  merely  changing  the  mean  square  voltage  level  in 
a  random  noise  generator. 
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In  Figure  16.  5,  the  parameter  a  is  a  fractional  deviation  in  the 

actual  mean  square  value  of  the  signal  from  some  average  mean  square 
2 

level  cr^  For  example,  if  a  =  0.  10,  the  nonstationarity  is  represented 

by  a  signal  with  a  mean  square  level  that  is  10%  above  the  average  level 

2  2 

(T  for  the  first  half  of  the  record  and  10%  below  the  average  level  o' 

X  X 

for  the  second  half  of  the  record.  The  magnitude  of  nonstationarity  is 
measured  in  terms  of  the  deviation  a. 

16.  2.  4  Procedures  for  Comparing  Stationarity  Tests  A,  B,  and  C 

The  objective  is  to  empirically  study  the  relative  effectiveness  of 
Stationarity  Tests  B  and  C,  along  with  Test  A,  assuming  its  validity  is 
substantiated,  when  they  are  applied  with  the  same  level  of  significance 
to  the  same  nonstationary  data.  A  nonstationary  signal  is  contrived 
with  the  characteristics  discussed  in  Section  16.  2.  3.  That  is,  a 
sample  record  of  length  T  is  obtained  from  a  signal  whose  true  mean 
square  value  is  someia%  above  and  below  an  average  level  for  each  half 
of  the  record.  A  collection  of  N  number  of  subrecords  are  gathered 
and  tested  for  stationarity  by  each  of  the  three  tests  at  an  a  level  of 
significance.  The  experiment  is  repeated  M  number  of  times  to 
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empirically  establish  how  often  each  test  will  accept  or  reject  a 
stationary  hypothesis.  The  group  of  experiments  is  performed  for  k 
number  of  different  cases  of  nonstationarity. 

More  specifically,  Stationarity  Tests  A,  B,  and  C  are  applied  to 
a  random  signal  with  a  bandwidth  of  B  =  56  cps  on  a  center  frequency 
of  f^  =  1000  cps.  A  total  of  N  =  10  mean  square  estimates  are 
measured  at  equally  spaced  intervals  from  a  continuous  RC  averaged 
mean  square  level  time  history  plot.  The  continuous  mean  square 
estimate  is  for  an  averaging  time  constant  of  K  0.  27  seconds  giving 
an  effective  averaging  time  per  subrecord  of  T^  =  2K  0,  54  seconds. 
Thus,  each  estimate  is  based  on  n  =  2BT^  «  60  equivalent  number  of 
events.  The  interval  between  the  individual  estimates  is  one  second 
(about  4K)  to  assure  statistical  independence.  For  an  actual  example 
of  a  continuous  RC  averaged  mean  square  estimate,  see  Figure  13.  3. 

The  ten  mean  square  values  are  tested  for  stationarity  by  each  of  the 
three  tests  at  the  a  =  0.  05  level  of  significance. 

The  experiment  is  repeated  M  =  31  times  for  k  =  3  different 

All  ten  mean  square  estimates  are  obtained  from 
a  stationary  random  signed. 

The  mean  square  estimates  are  obtained  from  a 

random  signal  with  a  true  mean  square  value  of 

2  2 

1.  Ic  for  the  first  five  estimates  and  0.9 o' 

X  ^  TL 

for  the  last  five  estimates  where  v  is  an 

X 

arbitrary  average  mean  square  level  for  the  record. 
The  mean  square  estimates  are  obtained  from  a 

random  signal  with  a  true  mean  square  value  of 

2  2 

1.2  0-^  for  the  first  five  estimates  and  0. 

for  the  last  five  estimates. 

For  Case  1,  each  of  the  stationarity  tests  should  accept  the 
hypothesis  of  stationary  at  the  5%  level  of  significance  about  95%  of 
the  time.  A  rejection  of  the  hypothesis  is  a  Type  I  error  which  is 
fixed  at  5%  (a  =  0.  05)  for  each  test.  Thus,  for  31  experiments,  one 
or  two  Type  I  errors  would  be  anticipated.  For  Cases  2  and  3,  each 


cases  as  follows. 

Case  1. 

Case  2. 

Case  3. 
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of  the  stationarity  tests  would  ideally  reject  the  hypothesis  of 
stationarity.  An  acceptance  for  these  cases  is  a  Type  II  error.  For 
each  test,  an  empirical  probability  for  the  Type  II  error  (P),  and  a 
power  factor  for  the  test  (1  -  P)  is  computed  as  follows. 


p  _  number  of  acceptances 
31 

Power  of  Test=  1  -  P 


(16.  34) 


These  empirical  quantities  permit  comparison  of  the  relative  power 
of  the  three  stationarity  tests. 

16.  2.  5  Acceptance  Intervals  for  Stationarity  Tests 

(a)  Test  A 

-  2 

From  Eq.  (16.  3),  for  n  =  60  and  p  =  0.  50,  the  x  probability 

interval  is  given  by 

0.  870x^*  ^  1.  12x^ 

1 

”2  ,  2 
where  x  is  the  average  of  the  ten  values  for  x^  . 

From  Eq.  ( 16.  5),  for  N  =  10,  p  =  0.  50,  and  a 

of  acceptance  for  the  hypothesis  of  stationarity  is 

q  -c  8  (16.  36) 

The  above  number  is  arrived  at  by  using  binomial  probabilities  from 
Table  A-29a  of  Ref.  ^2j  and  determining  that  Value  of  k  in  Eq.  (16.  5) 
such  that  the  probability  is  0.  95. 

(b)  Test  B 

From  Eq.  (16.  18)  or  Figure  16.  2,  for  N  =  10  and  a  =  0.  05,  the 
region  of  acceptance  for  the  hypothesis  of  stationarity  is 

_  ^  1.  69  (16.  37) 

2 

€ 

Here,  for  n  =  60  (BT^  =  30),  from  Eq.  (16.13),  €^  =  0.0333. 


(16.  35) 

=  0.  05,  the  region 
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(c)  Test  c 

From  Eq.  ( 16.  23)  or  Figure  16.  3,  for  n  =  60,  N  =  10,  and  |a  =  0.  05, 
the  region  of  acceptance  for  the  hypothesis  of  stationarity  is 


max 


2.  26 


min 


(16.  38) 


16.3  INSTRUMENTATION 

The  instruments  and  test  set-up  are  exactly  as  employed  for  the 
experiments  in  Section  13.  The  power  spectral  density  analyzer  is 
used  to  obtain  mean  square  estimates  by  either  linear  integration  or 
RC  averaging.  See  Section  13.  3  for  details. 

16.  4  RESULTS  OF  EXPERIMENTS 
16.4.1  Verification  of  Stationarity  Test  A 

The  25  mean  square  estimates  gathered  for  each  of  the  31  dxperi- 
ments  are  presented  in  Table  16.  1.  The  average  value  for  all  of  the 

775  estimates  collected  is  5.  078.  This  value  is  used  as  the  true  mean 

2  2 
square  level  for  the  signal.  Then,  from  Eq.  (16.  3),  the  50%  x 

probability  interval  is 

Prob  [4.  60  -=  x.^  -  5.  54  ]  =  0.  50 

The  values  presented  in  Table  16.  1  have  two  significant  figures. 

2 

The  upper  x  limit  poses  no  problem  since  a  value  of  5.  5  is  definitely 

inside  the  interval  and  5.  6  is  definitely  a  failure  q.  However,  for  the 

lower  limit  of  4.  60,  a  problem  arises.  A  value  of  4.  6  means  that  the 

mean  square  estimate  is  between  4.  55  and  4.  65.  It  could  be  inside 
2 

or  outside  the  x  interval.  For  these  reasons,  a  value  of  4.  6  in 
Table  16.  1  is  counted  as  half  a  failure. 

The  number  of  failures  q  for  each  experiment  in  Table  16.  1 
are  presented  in  Table  16.  2. 
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T*bl«  16.  1.  MMn  Squar«  S«Um»t««  for  •  SCationary  Random  Signal  (n  >  112) 


Table  16.  2  Number  of  Failures  from  Table  16.  1 

Using  £q.  (16.  28),  the  sample  mean  and  variance  for  the  31  values 
of  q  in  Table  16.  2  are  as  follows. 

q  =  12.  45 

s^  =  6.  0 

s  =  2.  4 

From  Eqs.  (16.  30)  and  (16.  31)  where  s  =  2.  4,  the  regions  of 

2  2 

acceptance  for  the  hypotheses  that  <1  =  ^nd  s  =  are  as 
follows. 

-0.  14  (q  -  p  )  ■«  0.  14 
2 

0.  60  -  ^  1.  4 

<r 

q 

2 

Since  u  =  12.  5  and  cr  =6.  25, 

q  q 

q  -  u  =  12.  45  -  12.  50  =  -0.  05 
f‘q 


4=  ^  =0.96 
<r  6.  25 
q 
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Thus,  the  hypothesis  of  equivalence  for  both  the  mean  value  and 
variance  is  accepted  and  £q.  (16.4  )  is  considered  valid. 

16.  4.  2  Results  for  Stationarity  Tests  A,  B,  and  C 

The  ten  mean  square  estimates  gathered  for  each  of  the  31 
experiments  with  a  stationary  random  signal  (Case  1)  are  presented 
in  Table  16.  3.  The  results  of  the  experiments  for  a  ±  10%  non¬ 
stationary  random  signal  (Case  2)  are  presented  in  Table  16.  4.  The 
results  of  the  experiments  for  a  ±.  20%  nonstationary  random  signal 
(Case  3)  are  presented  in  Table  16.  5. 

Results  for  the  application  of  Stationarity  Test  A  to  Cases  1,  2, 
and  3  are  shown  in  Tables  16.  6,  16.  7,  and  16.  8,  respectively.  The 
results  for  Stationarity  Test  B  are  shown  in  Tables  16.  9,  16.  10,  and 
16.  11.  The  results  for  Stationarity  Test  C  are  shown  in  Tables  16.  12, 
16.  13,  and  16.  14. 

16.  4.  3  Comparison  of  Stationarity  Tests  A,  B,  and  C 

From  Tables  16.  6,  16.  9,  and  16.  12,  it  is  seen  that  the  appli¬ 
cation  of  each  stationarity  test  to  stationary  data  produced  a  single 
rejection  for  31  repeated  experiments.  This  rejection  is  a  Type  I 
error  (the  hypothesis  is  rejected  when  in  fact  it  was  true).  For  a 
hypothesis  test  at  the  5%  level  of  significance  which  is  repeated  31 
times,  an  average  of  1.  5  Type  I  errors  would  be  anticipated,  so  the 
single  rejections  are  consistent  with  expectatipns. 

For  the  application  of  each  stationarity  test  to  nonstationary 
data,  a  rejection  is  desired  and  an  acceptance  constitutes  a  Type  II 
error  (the  hypothesis  is  accepted  when  in  fact  it  is  false).  These 
data  from  Tables  16.  7,  16.  8,  16.  10,  16.  11,  16.  13,  and  16.  14  are 
summarized  in  Table  16.  15. 

It  is  clear  from  Table  16.  15  that  Stationary  Test  B  is  the  most 
powerful  of  the  three  tests  studied.  Stationarity  Test  C  ranks 
second  in  power.  Stationarity  Test  A,  the  test  originally  proposed 
in  Ref.  f  1  ] ,  is  the  least  powerful. 
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Exper. 

2 

Mean  Square  Estimates  x.  for  Stationary  Signal  -  Case  1 
B=56  cps,  f^=  1000  cps,  =  0.  54  (RC  averaging),  n=60 

iNuTTiDcr 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

1 

2.  25 

1.  78 

2.  26 

2.07 

1.91 

2.  00 

2.  19 

3.  20 

2 

2.  30 

2.86 

2.  68 

2.  15 

2.  54 

2.  00 

3.  05 

2.  15 

3 

2.  36 

2.03 

2.  00 

2.57 

2.  21 

1.47 

2.44 

3.  27 

2.49 

4 

3.  43 

2.  31 

1.54 

2.  89 

1. 90 

2.  08 

2.  19 

2.  18 

2.52 

2.  20 

5 

2.  02 

2.  25 

2.  73 

2.  49 

2.  60 

2.  17 

3.  09 

2.  35 

2.  21 

3.  00 

6 

1. 56 

1.40 

2.  12 

2.  11 

2.  16 

2.  69 

1. 83 

2.  74 

2.32 

2.  50 

7 

2.  99 

2.  43 

2.  51 

1.96 

2.  04 

2.  46 

2.  09 

1.86 

2.  21 

2.  30 

8 

2.  66 

3.  18 

1. 94 

2.  20 

2.  29 

2.  55 

1. 89 

2.54 

2.  50 

2.36 

9 

2.  11 

2.  20 

2.  36 

3.  01 

3.  03 

2.53 

2.  43 

2.  45 

2.08 

2.  53 

10 

2.  50 

3.  25 

2.80 

2.  50 

2.  54 

2.50 

2.  10 

2.  50 

1. 79 

2.  26 

11 

2.  32 

2.66 

2.  74 

2.  11 

;  2.99 

1.  95 

1.89 

2.91 

2.  01 

3.  40 

12 

2.  60 

2.40 

2.  49 

2.63 

1  2.  64 

2.  11 

2.  61 

2.89 

1.62 

2.  20 

13 

2.  56 

2.09 

3.  05 

2.  21 

2.  30 

2.  03 

1. 98 

2.  31 

2.00 

2.  03 

14 

2.  44 

3.  35 

2.30 

1.80 

2.  40 

2.35 

2.  30 

2.41 

2.  21 

1.64 

15 

2.47 

1.66 

2.39 

1.95 

2.  19 

2.  11 

2.  92 

3.  16 

2.60 

1.89 

16 

1. 33 

2.61 

2.  35 

2.90 

2.  32 

2.  98 

2.  22 

2.  11 

2.45 

2.  07 

17 

1. 90 

2.  99 

2.  51 

2.41 

1.  90 

2.  00 

2.  42 

1. 71 

1.  74 

2.  13 

18 

2.  15 

2.  22 

1.98 

2.  92 

2.  27 

3.  09 

2.  47 

2.  69 

2.  07 

2.  72 

19 

2.  36 

2.86 

2.  80 

2.  65 

2.  12 

2.  77 

2.  76 

1.68 

2.04 

2.45 

20 

1.  74 

2.  51 

2.45 

2.  27 

2.  18 

2.  92 

1.99 

2.  63 

2.69 

2.  50 

21 

2.  33 

2.00 

2.  04 

2.  12 

1.  90 

3.  63 

2.21 

1.99 

2.40 

1.37 

22 

1. 63 

2.  55 

2.  04 

2.  91 

2.  40 

3.  10 

2.49 

2.  53 

2.39 

2.89 

23 

2.  14 

2.  00 

1.  97 

2.  23 

1.  72 

2.  91 

2.  70 

3.  00 

2.02 

2.  90 

24 

2.  25 

2.11 

2.  51 

1.  74 

2.  13 

1.  82 

2.  52 

2.  55 

2.46 

1.  84 

25 

2.  90 

2.  72 

2.  67 

1. 90 

2.  40 

2.  67 

2.  19 

2.  40 

2.30 

2.  41 

26 

2.68 

2.  23 

1.92 

2.  15 

2.  35 

2.  72 

1. 65 

2.  41 

2.30 

2.  53 

27 

3.  10 

2.  24 

2.30 

2.  36 

1.  67 

2.  50 

2.  25 

2.  89 

2.  71 

2.  12 

28 

2.09 

2.  53 

2.  25 

1.84 

2.  92 

2.  95 

2.  72 

2.  76 

3.  39 

2.  38 

29 

2.  76 

2.45 

2.  50 

2.  22 

2.30 

2.  71 

1.  75 

2.55 

2.52  1 

2.  14 

30 

2.61 

2.  22 

2.  78 

1.96 

2.  44 

2.  52 

2.  20 

1. 53 

2.  11 

2.  01 

31 

2.49 

2.  32 

2.  79 

2.  68 

2.  52 

2.41 

2.81 

2.  78 

2.49 

2.  13 

Table  16.  3.  Mean  Square  Estimates  for  Stationary  Random  Signal  -  Case  1 
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Exper. 

2 

Mean  Square  Estimates 
B=56  cps,  f^=  1000  cps, 

for  +10%  Nonstationary  Signal  “  Case  2 

Tj  =  0.  54  seconds  (RC  averaging),  n=60 

Number 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

1 

3.  54 

1.  95 

2.86 

1.88 

1. 97 

2.  47 

2.  00 

2.  20 

2.  22 

1. 68 

2 

2.  29 

3.  48 

2.87 

2.  45 

2.  20 

2.  49 

1. 52 

1.  70 

2.  02 

2.09 

3 

2.  51 

2.  39 

3.  27 

2.  19 

3.  04 

2.  43 

1.  70 

1.  64 

1.82 

1. 97 

4 

2.  54 

3.  07 

3.  58 

3.  04 

2.  07 

1.95 

2.  34 

2.  06 

2.  02 

2.  45 

5 

2.  20 

2.  49 

2.47 

2.  22 

2.  20 

2.  10 

1. 61 

2.  12 

1.  75 

1. 69 

6 

2.  15 

3.  13 

3.  11 

2.  12 

3.  11 

2.  04 

1. 35 

3.  09 

3.  15 

1. 50 

7 

2.  36 

2.  65 

2.  46 

2.65 

3.98 

2.  00 

1.  60 

2.  71 

2.  02 

2.  34 

8 

3.  00 

2.  12 

2.  68 

3.  24 

2.  32 

2.  34 

2.  00 

2.  08 

2.  11 

1.96 

9 

2.  40 

2.  71 

2.  33 

2.  84 

2.  28 

2.  62 

2.  25 

2.  11 

2.  43 

1.95 

10 

2.43 

2.  75 

2.  64 

2.37 

2.  65 

2.  27 

2.  29 

2.  04 

1. 97 

2.  43 

11 

2.  24 

3.53 

2.  21 

2.49 

2.81 

2.  03 

1.43 

1.  71 

1. 92 

2.  60 

12 

2.  30 

2.  38 

2.  74 

2.  87 

2.  38 

2.  25 

2.45 

2.  27 

1.  76 

2.  25 

13 

2.  55 

2.  68 

1.91 

2.09 

2.  24 

2.  47 

1.  74 

1.  71 

1.90 

1.  74 

14 

2.  17 

2.  22 

3.  10 

2.  59 

2.  72 

2.  41 

1.62 

2.  45 

1.54 

2.  00 

15 

2.  57 

2.  15 

2.  71 

2.  50 

1.  76 

2.  30 

1.80 

1.69 

2.  51 

2.40 

16 

2.  50 

2.  40 

2.  47 

2.  11 

1.92 

1.  73 

2.  21 

1.93 

2.05 

1. 88 

17 

2.89 

2.  60 

2.  97 

3.  22 

2.  10 

2.  44 

2.  51 

2.08 

2.  66 

2.  36 

18 

2.  57 

2.  82 

2.  31 

2.  17 

2.39 

2.  09 

2.  43 

1.89 

2.  08 

2.  35 

19 

2.  50 

2.  92 

3.  21 

2.  29 

2.  24 

2.  01 

2.  18 

2.49 

2.  05 

1. 81 

20 

2.  92 

2.  05 

2.14 

1. 54 

2.  55 

2.  42 

1 . 66 

1. 90 

1.85 

1.  76 

21 

2.  28 

2.43 

2.09 

2.  64 

2.  62 

2.  60 

2.  32 

2.  05 

1.  79 

2.  00 

22 

3.  25 

3.  04 

2.  00 

3.  87 

2.  25 

2.  20 

1. 60 

2.  18 

2.  56 

1. 50 

23 

2.  96 

2.  18 

2.  15 

1.84 

2.  38 

1. 80 

2.  09 

1. 62 

2.02 

2.  53 

24 

2.  13 

3.  22 

2.  90 

2.  26 

1.97 

2.  84 

2.  33 

3.  17 

2.  11 

2.  12 

25 

2.  32 

2.  87 

1.95 

2.83 

3.  32 

1.86 

1.86 

2.  52 

2.  00 

2.  51 

26 

1. 94 

2.  71 

1. 92 

2.  22 

2.  69 

1.  79 

2.  73 

1.99 

1. 68 

1.85 

27 

2.48 

3.  00 

2.  39 

3.  15 

3.  00 

1.96 

2.  15 

1. 61 

1.  76 

1.59 

28 

2.  27 

3.  10 

2.47 

2.  50 

1.92 

1.69 

2.49 

1.59 

1.82 

2.  13 

29 

2.  39 

1.91 

2.43 

2.47 

2.45 

1.83 

2.31 

3.  03 

2.  10 

1.  61 

30 

2.  34 

2.  30 

3.47 

2.92 

3.  35 

2.  02 

2.  34 

1.60 

1.  73 

2.05 

31 

2,89 

2.  60 

2.  97 

2.88 

1.94 

2.  10 

2.49 

1.98 

1.80 

2.33 

Table  16.4.  Mean  Square  Estimates  for  Nonstationary  Random  Signal  -  Case  2 
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Exper. 

Number 

Mean  Square  Estimates  x. 
B=56  cps,  f^=  1000  cps,  ' 

2 

for  20%  Nonstationary  Signal  -  Case  3 
"j  =  0.  54  seconds  (RC  averaging),  n  =  60 

1 

2 

3 

4 

5 

6 

7 

8 

_ 

9 

10 

1 

2. 

02 

1.90 

1. 

61 

2. 

30 

2. 

43 

0.92 

B 

0.98 

1. 

09 

2 

1. 

66 

1.85 

2. 

20 

1. 

47 

1. 

93 

■wij 

1. 01 

|f 

0.  92 

1. 

33 

3 

2. 

08 

1.  68 

2. 

25 

1. 

61 

2. 

33 

■Kil 

1.44 

1.  20 

1. 

04 

4 

2. 

00 

2.  46 

1. 

74 

1. 

53 

2. 

42 

1. 05 

0.  98 

0.  93 

0. 

81 

5 

3. 

92 

2.  11 

1. 

78 

1. 

81 

2. 

41 

1. 40 

1.  23 

1. 

15 

1.  70 

0. 

93 

6 

3. 

55 

2.  01 

1. 

70 

2. 

00 

2. 

08 

1.  20 

1.69 

1. 

40 

0.  94 

1. 

29 

7 

1. 

91 

2.  96 

1. 

49 

2. 

12 

2. 

41 

1.  52 

1. 30 

1. 

07 

0.99 

1. 

01 

8 

2. 

06 

2.  28 

2. 

40 

1. 

66 

2. 

59 

1. 38 

1. 97 

1. 

16 

1.09 

1. 

10 

9 

2. 

28 

2.  48 

2. 

30 

1. 

74 

2. 

36 

1.  17 

1. 38 

1. 

10 

1.  19 

1. 

07 

10 

1. 

70 

2.  02 

2. 

30 

2. 

27 

1. 

69 

1.  24 

1. 38 

1. 

22 

1.  28 

1. 

06 

11 

2. 

62 

1.  76 

1. 

96 

2. 

46 

1. 

75 

1.  57 

1.35 

1. 

32 

1. 25 

2. 

00 

12 

1. 

50 

1. 83 

2. 

27 

2. 

50 

2. 

54 

1.  70 

0.  97 

1. 

12 

1.52 

1. 

67 

13 

2. 

42 

2.  50 

2. 

29 

1. 

92 

1. 

98 

0.  93 

1. 58 

1. 

20 

1.  20 

1. 

29 

14 

2. 

28 

1.95 

2. 

40 

2. 

10 

2. 

20 

1. 38 

1. 42 

1. 

03 

1.  28 

1. 

25 

15 

2. 

59 

2.  34 

2. 

20 

1. 

60 

2. 

42 

1.  19 

1.  19 

0. 

81 

1.  12 

1. 

21 

16 

1. 

96 

2.  31 

2. 

36 

2. 

17 

2. 

94 

1.  47 

1. 37 

1. 

46 

1.11 

1. 

37 

17 

1. 

70 

1.  73 

2. 

30 

2. 

38 

1. 

85 

0.84 

0.83 

1. 

08 

1.58 

1. 

53 

18 

1. 

90 

2.  04 

2. 

08 

2. 

18 

2. 

29 

1.  29 

1.85 

1. 

20 

1.  17 

1. 

30 

19 

2. 

06 

2.  02 

1. 

82 

1. 

58 

2. 

04 

1.  44 

1.00 

1. 

55 

1. 57 

1. 

13 

20 

1. 

72 

1. 67 

2. 

38 

2. 

53 

2. 

32 

1. 28 

1. 08 

1. 

73 

1.  37 

1. 

23 

21 

2, 

68 

1. 93 

1. 

90 

2. 

06 

2. 

02 

1. 64 

1.40 

1. 

72 

1.  24 

1. 

67 

22 

1, 

89 

2.  64 

2. 

44 

2. 

43 

2. 

97 

1. 08 

0.  98 

1. 

48 

1. 37 

1. 

25 

23 

1. 

82 

2.  16 

2. 

14 

2. 

61 

1. 

91 

1. 22 

1. 40 

1. 

09 

1.  16 

1. 

55 

24 

2, 

42 

2.88 

1. 

70 

1. 

53 

1. 

93 

1. 30 

1.  12 

1. 

23 

1.  31 

1, 

70 

25 

2. 

20 

2.  17 

1. 

70 

1. 

91 

2. 

82 

1.  04 

1. 68 

1. 

38 

1.07 

1. 

20 

26 

2. 

05 

2.  70 

1. 

51 

2. 

70 

1. 

69 

1. 40 

1. 43 

1. 

20 

1.60 

1. 

26 

27 

1. 

67 

2.  20 

2. 

27 

1. 

62 

2. 

40 

1.  27 

1. 04 

1. 

39 

2.01 

1. 

37 

28 

1, 

83 

3.  02 

2. 

99 

2. 

50 

2. 

40 

1.32 

1.37 

1. 

10 

1.  26 

1. 

43 

29 

2. 

33 

2.  03 

2. 

12 

1. 

88 

2. 

20 

1.  24 

1.40 

1. 

24 

1.  22 

1. 

42 

30 

1. 

90 

2.  36 

2. 

61 

2. 

18 

2. 

63 

1. 40 

1. 39 

1. 

70 

0.  96 

1. 

60 

31 

2. 

25 

2.  06 

2. 

42 

2. 

27 

3. 

00 

1.  37 

1.  10 

1. 

03 

1.62 

1. 

24 

Table  16.  5.  Mean  Square  Estimates  for  Nonstationary  Random  Signal  -  Case  3 
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Exper. 

Number 


Results  for  Stationarity  Test  A  Applied  to 
Stationary  Data  -  Case  1,  Table  16.3 


2.  296 
2.  428 
2.413 
2.  324 
2.  491 
2.  143 
2.  285 
2.  411 
2.  473 
2.  474 
2.498 
2.419 
2.  256 
2.  320 
2.  334 
2.  336 
2.  170 
2.  458 
2.  449 
2.  388 
2.  199 
2.493 
2.  359 
2.  193 
2.  456 
2.  294 
2.  414 
2.  583 
2.  390 
2.  238 
2.542 


50%  yf  interval 

lower 

upper 

limit  —j 
0.870 

limit-- 
1.  12  x'^ 

2.00 

2.  57 

2.  11 

2.  72 

2.  10 

2.  70 

2.  02 

2.  60 

2.  17 

2.  79 

1.86 

2.  40 

1.99 

2.  56 

2.  10 

2.  70 

2.  15 

2.  77 

2.  15 

2.  77 

2.  17 

2.  80 

2.  10 

2.  71 

1.96 

2.  53 

2.  02 

2.  60 

2.03 

2.  61 

2.03 

2.62 

1.89 

2.43 

2.  14 

2.  75 

2.  13 

2.  74 

2.  08 

2.  67 

1.91 

2.  46 

2.  17 

2.  79 

2.05 

2.  64 

1.91 

2.  46 

2.  14 

2.  75 

2.00 

2.  57 

2.  10 

2.  70 

2.  25 

2.89 

2.08 

2.  68 

1.95 

2.51 

2.  21 

_ 

2.85 

Number  of 
Failures 


Region,  of  Acceptance 
q<  8 


accepted 
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— 

Exper. 

Number 

Results  for  Stationarity  Test  A  Applied  to 
+  10%  Nonstationary  Data  -  Case  2,  Table  16.4 

2^2 

X 

X 

2 

50%  X  interval 

Number  of 
Failures 

q 

Region  of  Acceptance 
q48 

lower 
limit -- 
0.870  x^ 

upper 

limit— 

1.  12  x^ 

1 

2.  277 

1. 98 

2.55 

6 

accepted 

2 

2.  311 

2.  01 

2.  59 

4 

3 

2.  296 

2.00 

2.  57 

6 

4 

2.  512 

2.  18 

2.81 

7 

5 

2.  085 

1.81 

2.  34 

5 

accepted 

6 

2.  475 

2.  15 

2.  77 

10 

rejected 

7 

2.  477 

2.  15 

2.  77 

4 

accepted 

8 

2.  385 

2.  07 

2.  67 

5 

9 

2.  392 

2.08 

2.  68 

3 

10 

2.  384 

2.  07 

2.  67 

3 

11 

2.  297 

2.  00 

2.  57 

6 

12 

2.  365 

2.  06 

2.  65 

3 

13 

2.  103 

1.83 

2.  36 

6 

14 

2.  282 

1. 98 

2.  56 

5 

15 

2.  239 

1.95 

2.  51 

6 

16 

2.  120 

1.84 

2.  37 

4 

17 

2.  583 

2.  25 

2.  89 

5 

18 

2.  310 

2.  01 

2.59 

2 

19 

2.  370 

2.  06 

2.  65 

5 

20 

2.  079 

1.81 

2.  33 

6 

21 

2.  282 

1. 98 

2.  56 

4 

22 

2,  445 

2.  13 

2.  74 

6 

V 

23 

2.  157 

1.88 

2.42 

5 

accepted 

24 

2.  505 

2.  18 

2.  80 

8 

rejected 

25 

2.  404 

2.  09 

2.  69 

7 

accepted 

26 

2.  152 

1.87 

2.  41 

6 

27 

2.  309 

2.  01 

2.59 

7 

28 

2.  198 

1. 91 

2.  46 

7 

29 

2.  253 

1.96 

2.  52 

4 

30 

2.  412 

2.  10 

2.  70 

7 

/ 

31 

2.  398 

2.  09 

2.  68 

6 

accepted 

Table  16.  7.  Results  for  Stationarity  Test  A  Applied  to  Case  2 
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Exper. 

Number 

Results  for  Stationarity  Test  A  Applied  to 
+  20%  Nonstationary  Data  -  Case  3,  Table  16.  5 

2  2 

X  (T 

X 

2 

50%  X  interval 

Nvimber  of 
Failures 

q 

Region  of  Acceptance 
q4  8 

lower 
limit  — » 
0.870  yi 

upper 

limit-5 

1.  12  X 

1 

1. 612 

1.80 

8 

rejected 

2 

1. 432 

1.60 

8 

rejected 

3 

1.  595 

1. 79 

6 

accepted 

4 

1.  517 

1. 32 

1. 70 

9 

rejected 

5 

1. 844 

1. 60 

2.  06 

7 

accepted 

6 

1.  786 

1. 55 

2.  00 

8 

rejected 

1.  678 

1.46 

1.88 

8 

1.  769 

1. 54 

1.98 

8 

1.  707 

1. 48 

1.91 

9 

Bm 

1.  616 

1.40 

1.81 

8 

rejected 

1.  804 

1. 57 

2.02 

6 

accepted 

1.  762 

1.53 

1. 97 

7 

accepted 

1.  731 

1. 50 

1.94 

8 

rejected 

1.  729 

1,50 

1.94 

15 

1. 667 

1.45 

1.87 

9 

16 

1.852 

1.61 

2.07 

9 

rej^ted 

17 

1.  582 

1. 38 

1.  77 

6 

accepted 

18 

1.  730 

1. 50 

1.94 

8 

rejected 

19 

1.621 

1.41 

1.82 

6 

accepted 

20 

1.  731 

1.50 

1.94 

7 

accepted 

21 

1. 826 

1.59 

2.04 

4 

accepted 

22 

1. 853 

1.61 

2.08 

9 

rejected 

23 

1.  706 

1.48 

1.91 

8 

rejected 

24 

1.  712 

1.49 

1.92 

7 

accepted 

25 

1.  717 

1.49 

1.92 

7 

accepted 

26 

1.  754 

1.52 

1.96 

8 

rejected 

27 

1.  724 

1. 50 

1.93 

8 

28 

1.  922 

1.67 

2.  15 

9 

29 

1.  708 

1.48 

1.91 

9 

30 

1.  873 

1.63 

2.  10 

8 

f 

31 

1. 836 

1.  60 

2.  06 

9 

rejected 

Table  16.8.  Results  for  Stationarity  Test  A  Applied  to  Case  3 
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Exper. 

Results  for  Stationary  Test  B  Applied  to  Stationary  Data  - 

Case  1,  Table  16.3 

Number 

2  2 

,2 

/n2 

€ 

Region  of  Acceptance 

X  i:^<T 

8 

/^2 

X 

mm 

*2 

-4-  <  1.69 
c 

1 

2.  296 

0.  171 

0.0324 

0. 0333 

0.  97 

accepted 

2 

2.428 

0.  106 

0.0180 

0.  54 

3 

2.  413 

0,  285 

0. 0490 

1. 47 

4 

2.  324 

0.  249 

0. 0461 

1. 38 

5 

2.  491 

0.  117 

0. 0189 

0.  57 

6 

2.  143 

0.  181 

0. 0394 

1.  18 

2.  285 

0.  099 

0.  019 

0.  57 

2.  411 

0.  125 

0. 0215 

0.  64 

2.  473 

0.  098 

0.  016 

0.  48 

2.  474 

0.  137 

0. 0224 

0.  67 

2.  498 

0.  240 

0. 0385 

1.  16 

2.  419 

0.  117 

0. 0200 

0.  60 

mSm 

2.  256 

0.  100 

0. 0196 

0.  59 

2.  320 

0.  184 

0. 0342 

1. 03 

15 

2.  334 

0.  198 

0. 0363 

1. 09 

16 

2..336 

0.  199 

0. 0364 

1. 09 

17 

2.  170 

0.  148 

0. 0314 

0.  94 

18 

2.  458 

0.  130 

0. 0215 

0.  64 

19 

2.  449 

0. 0233 

0.  70 

20 

2.  388 

0.  110 

0. 0193 

0.  58 

accepted 

21 

2.  199 

0.  299 

0. 0618 

1. 86 

rejected 

22 

2.  493 

0.  167 

0. 0268 

0.  80 

accepted 

23 

2.  359 

0.  199 

0. 0358 

1. 08 

24 

2.  193 

0.  089 

0.  019 

0.  57 

25 

2.  456 

0.  077 

0.  013 

0.  39 

26 

2.  294 

0.  099 

0.  019 

0.  57 

27 

2.  414 

0.  151 

0. 0259 

0.  78 

28 

2.  583 

0.  190 

0. 0285 

0.  86 

29 

2.  390 

0.  014 

0.  42 

30 

2.  238 

0.  120 

0. 0240 

f 

0.  72 

31 

2.  542 

0.  045 

0.  007 

0. 0333 

0.  21 

accepted 

Table  16.  9.  Results  for  Stationarity  Test  B  Applied  to  Case  1 
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Exper.  "3“ 
Number  2 

X  ; 


Results  for  Stationarity  Test  B  Applied  to 
+  20%  Nonstationary  Data  -  Case  3,  Table  16.  5 


0,  242 
0.  144 


.  464 
.  230 
.  286 
.  295 
.  275 
.  199 
.  494 
.  179 
.  284 
.  391 


0.0941 
0.  0873 


0.0333 


0,  0930  I 

0.  0708 
0.  0605 
0.  0834 
0.0968 
0.0769 

0.0898  1 

0.  0585 
0.  0468 
0.0808 
0.0432 

0.  0790 
0.  0976 

0.0894 
0.  0670 

0.  0614 

0.0810  V 

6  0.0333 


€ 

2 

€ 

2 

3. 

24 

2. 

82 

2. 

62 

4. 

44 

5. 

86 

4. 

47 

4. 

17 

2. 

79 

3. 

24 

2, 

13 

1. 

82 

2. 

50 

2. 

91 

2. 

31 

4. 

17 

2. 

70 

3. 

15 

1. 

76 

1. 

40 

2. 

43 

1. 

30 

4. 

05 

2. 

37 

2. 

93 

3. 

00 

2. 

68 

2. 

01 

4. 

02 

1. 

84 

2. 

43 

3. 

48 

Region  of  Acceptance 
<1.69 


rejected 


V 

rejected 


accepted 

rejected 


accepted 

rejected 
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Results  for  Stationarity  Test  C  Applied  to 
Stationary  Data  -  Case  1,  Table  16.3 


Exper. 

Number  ( 

X  Imax. 


3.  20 
3.  05 
3.  28 
3,  43 
3.  09 
2.  74 

2.  99 

3.  18 
3.  03 
3.  25 
3.  40 

2.  89 

3.  05 
3.  35 
3.  16 
2.98 
2.99 
3.  09 
2.  86 
2.  92 
3.  63 
3.  10 
3.00 
2.  55 
2.  90 

2.  72 

3.  10 
3.  39 
2.  76 
2.  78 
2.  81 


. 

X  min. 


1.  78 
2.00 
1. 47 
1. 54 

2.  02 
1.40 
1.86 
1. 89 
2.08 
1.  79 

1.89 
1.62 
1.98 

1. 64 
1 . 66 
1. 33 
1.  71 
1. 98 
1. 68 
1.  74 
1. 37 
1. 63 
1.  72 
1.  74 

1.90 

1. 65 
1. 67 
1. 84 
1.  75 

1.  53 

2.  13 


"T 

X  min. 


1. 80 

1.  52 

2.  23 
2.  23 
1.  53 
1. 96 
1.  61 
1.  68 
1. 46 
1. 82 
1. 80 
1.  78 

1.  54 

2.  04 

1.  90 

2.  24 
1.  75 
1.  56 

1.  70 

1.  68 

2.  65 
1. 90 
1.  74 
1. 46 
1. 53 
1. 65 
1. 86 
1. 84 
1. 58 
1. 82 
1. 32 


Region  of  Acceptance 


~2 

X  max. 


<  2.  26 


accepted 


accepted 

rejected 


accepted 


V 

accepted 
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Exper. 

Results  for  Stationarity  Test  C  Applied  to 

10%  Nonstationary  Data  -  Case  2,  Table  16.4 

j 

Number 

{  2) 

(x  1  max. 

Region  of  Acceptance 

1  X  1  min. 

1-7 

mm 

|”r) 

lx  1  mm. 

lx  /  max.  ^  2.26 

1 

^  . 

X  /  mm. 

1 

3.  54 

1.68 

2.  11 

accepted 

2 

3.  48 

1. 52 

2.  29 

rejected 

3 

3.  27 

1.64 

1. 99 

accepted 

4 

3.  58 

1.95 

1.84 

accepted 

5 

2.  49 

1.61 

1.  55 

accepted 

6 

3.  15 

1.35 

2.  33 

rejected 

7 

3.98 

1. 60 

2.  49 

rejected 

8 

3.  24 

1. 96 

1.  65 

accepted 

9 

2.  84 

1.95 

1.46 

accepted 

10 

2.  75 

1.97 

1.  40 

accepted 

11 

3.  53 

1.43 

2.  47 

rejected 

12 

2.87 

1.  76 

1.  63 

accepteid 

13 

2.68 

1. 71 

1. 57 

14 

3.  10 

1.54 

2.  01 

15 

2.  71 

1.69 

1.  60 

16 

2.  50 

1.  73 

1. 44 

17 

3.  22 

2.08 

1. 55 

18 

2.82 

1.89 

1.  49 

19 

3.  21 

1.81 

1.  77 

20 

2.92 

1.66 

1.  76 

j 

21 

2.  64 

1. 79 

1.47 

accepted 

22 

3.87 

1. 50 

2.  58 

rejected 

23 

2.  96 

1. 62 

1. 83 

accepted 

24 

3.  22 

1.97 

1.  63 

25 

3.  32 

1.86 

1.  78 

26 

2.  73 

1.68 

1.  62 

27 

3.  15 

1.59 

1.98 

28 

3.  10 

1.59 

1.95 

29 

3.03 

1.61 

1.88 

30 

3.47 

1.60 

2.  17 

31 

_ 

2.97 

1.80 

1.  65 

accepted 

Table  16.  13.  Results  for  Stationarity  Test  C  Applied  to  Case  2 
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Exper . 
Number 


Results  for  Stationarity  Test  C  Applied  to 
+  20%  Nonstationary  Data  “  Case  3,  Table  16.5 


Region  of  Acceptance 


2.  43 
2.  20 
2.  33 

2,  46 

3.  92 
3.  55 
2.  96 
2.  59 
2.  48 
2.  30 
2,  62 
2.  54 
2.  50 
2.  40 
2.  59 
2.  94 
2.  38 
2.  29 
2.  06 
2,  53 
2.  68 
2.  97 
2.  61 
2.  88 
2.  82 
2.  70 

2.  40 

3.  02 
2.  33 

2.  63 

3.  00 


0.  92 
0.  92 
0.89 
0.  81 
0.  93 
0.  94 
0.99 
1.09 
1.07 
1.06 
1. 25 
0.97 
0.93 
1.03 
0.81 
1.  11 
0.83 
1.  17 
1.00 
1. 08 
1. 24 
0.  98 
1. 09 
1.12 
1.04 
1. 20 
1.04 
1.  10 
1. 22 
0.  96 
1.03 


2.  6 

2.  4 

2.  6 

3.  0 

4.  2 
3.  8 
3.  0 
2.  38 
2.  32 
2.  17 
2.  10 
2.  6 
2.  7 

2.  33 

3.  2 
2.  65 
2.  9 

1.  96 

2.  06 

2.  34 
2.  16 

3.  0 
2.  39 
2.  57 
2.  71 
2.  25 
2.  31 
2.  74 
1. 91 
2.  7 
2.  91 


max. 


<:  2.  26 


rejected 


rejected 


accepted 

accepted 

rejected 


V 

rejected 


accepted 

accepted 

rejected 


accepted 

rejected 


I 

rejected 


accepted 

rejected 


rejected 


accepted 

rejected 


rejected 
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Summary  of  Stationarity  Test  Results: 

Relative  Power  of  Tests  A,  B,  and  C 

„  •  ■  ,  1  r  Q  (number-of  acceptances) 

Empirical  Value  for  p  =  - s- - 

(number  of  experiments  ) 

Power  of  Test  =  1  -  (3 

Stationarity- 

±  10  Nonstationarity 

Case  2 

±  20  Nonstationarity 

Case  3 

Test 

Number  of 
Acceptances 

P 

Power 

(1  -  P) 

Number  of 
Acceptances 

P 

Power 

(1  -  P) 

A 

fTable  16.7 
[Table  16.8 

29 

0.  94 

0.  06 

10 

0.  32 

0.  68 

B 

fTable  16. 10 
iTable  16.  1 1 

24 

0.  77 

0.  33 

2 

0.  06 

0.  94 

C 

fTable  16. 13 
ITable  16. 14 

26 

0.  84 

0.  16 

7 

0.  22 

0.  78 

Table  16.  15  Summary  of  Stationarity  Test  Results 
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16.  5  DISCUSSION  OF  RESULTS 

16,  5.  1  Relative  Power  of  Stationarity  Tests 


It  is  seen  from  Table  16.  15  that  Test  B  is  the  most  powerful  and 
Test  A  is  the  least  powerful  of  the  three  Stationarity  Tests  for  the  cases 
studied.  These  results  are  logical  when  one  considers  the  amount  of  data 
employed  by  each  test  to  reach  a  decision. 

Test  B  effectively  uses  all  the  information  that  is  available;  namely, 
the  actual  value  for  each  of  the  N  number  of  mean  square  estimates 
obtained.  Test  C  uses  only  two  of  the  actual  values,  the  maximum  and 
minimum  mean  square  measurements,  plus  the  knowledge  that  the  remain¬ 
ing  (N  -  2)  mean  square  measurements  fall  between  those  two  extreme 
values.  Test  A  uses  no  actual  values.  The  only  information  employed  is 

the  knowledge  that  a  certain  number  q  of  the  measurements  fall  outside 
2 

a  given  x  probability  interval.  Thus,  the  relative  power  of  the  three 
tests,  as  determined  empirically  in  Table  16.  15,  is  consistent  with  the 
amount  of  actual  data  employed  by  each  test  to  reach  a  decision. 

Now  consider  the  three  Stationarity  Tests  in  terms  of  their  relative 
desirability  as  measured  by  the  combination  of  power  and  simplicity  in 
application.  Test  A  is  the  least  powerful  and  also  the  most  difficult  to 
apply  in  actual  practice.  Thus,  Test  A  is  clearly  the  least  desirable  of 
the  three.  The  relative  desirability  of  Tests  B  and  C  is  not  so  clear.  Test 
B  is  the  more  powerful  while  Test  C  is  simpler  to  apply.  If  the  data 
analyst  has  a  digital  computer  at  his  disposal  to  accomplish  numerical 
computations  with  high  speed.  Test  B  would  be  the  more  desirable  since 
the  required  computations  would  be  no  problem.  However,  if  the  data 
analysis  is  accomplished  by  hand.  Test  C  might  be  considered  more 
desirable  because  of  its  simplicity. 

16.  5.  2  Application  of  Analysis  of  Variance  Techniques 

In  Section  8,  procedures  are  detailed  for  testing  the  equivalence  of 
mean  square  measurements  obtained  from  different  flights.  These  techniques, 
whdch  are  the  classical  analysis  of  variance  procedures,  do  not  require  a 
knowledge  of  n  =  2BTj.  Furthermore,  because  the  techniques  employ  all 
the  data  available  from  multiple  flights,  they  detect  with  great  power  any 
common  trend  within  flights  as  well  as  significant  differences  between  flights. 
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The  data  presented  in  Section  16.  4  presents  an  excellent  opportunity  to 
illustrate  the  application  of  a  one  way  analysis  of  variance  procedure 
as  a  test  for  stationary  in  repeated  flights. 

Consider  the  mean  square  level  data  for  nonstationarity  Case  2, 
presented  in  Table  16.  4.  Each  experiment  may  be  considered  a  flight 
where  10  mean  square  measurements  were  obtained  during  the  flight. 
For  the  following  example,  experiments  number  1,  2,  and  3  are  used  to 
represent  three  similar  flights  where  mean  square  measurements  are 
obtained  at  similar  times  during  the  flights.  The  flights  are  tested  for 
stationarity  at  the  a  =  0.  05  level  of  significance. 

The  appropriate  data  from  Table  16.  4,  is  shown  in  Table  16.  16  in 
the  desired  format  for  a  one  way  analysis  of  variance. 


One  Way  Analysis  of  Variance 

3  Flights,  10  Measurements  per  Flight 

Measurement 

Number 

Flight  1 

Flight  2 

Flight  3 

1 

3.  54 

2.  29 

2.  51 

2 

1.95 

3.  48 

2.  39 

3 

2.  86 

2.  87 

3.  27 

4 

1.  88 

2.  45 

2.  19 

5 

1.  97 

2.  20 

3.  04 

6 

2.  47 

2.  49 

2.  43 

7 

2.  00 

1.  52 

1.  70 

8 

2.  20 

1.  70 

1.  64 

9 

2.  22 

2.  02 

1.  82 

10 

1.  68 

2.  09 

1.  97 

Table  16.  16  One  Way  Analysis  of  Variance  Table 
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Using  the  computational  procedures  and  notation  outlined  in  Section  8, 
the  following  results  are  obtained. 


^6 


r 


8.  34;  R2  =  7.  82;  =  9.  00;  R^  =  6.  52;  R^  =  7.  21 

7.  39;  R.^  =  5.  22;  Rg  =  5.  54;  R^  =  6.  06;  R^^  =  5.  74 

10 


10  rows;  c  =  3  columns;  T  = 


R.  =  68.  84 
1 


158.  0; 


166.  3; 


R^=  3(162,  8) 


SS3  =  162.  8  -  158.  0  =  4.  8 

SS  =  166.  3  -  158.  0  =  8.  3 

SS2  =  8.  3  -  4.  8  =  3.  5 


>!< 

SS,  =  -  =  0.  53  with  (r  -  1)  =  9  degrees  of  freedom 

^  (r-l) 


*  ^^2 

SS,  = - -  0.  18  with  r(c  -  1)  =  20  degrees  of  freedom 

r{c  -  1) 


For  a 


0.  05, 


^(9,20) 


2.  9  »■  2.  39 


2.  39 


Thus,  the  hypothesis  of  equivalence  for  the  measurements  obtained  during 
the  flights  is  rejected  at  the  5%  level  of  significance,  and  the  flights  are 
correctly  interpreted  as  being  nonstationary. 
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16.  5.  3  Combined  Stationarity  and  Randomness  Test 


Referring  to  Randomness  Test  B  developed  in  Section  15.1.3,  it 

is  seen  that  the  principles  and  applications  of  Randomness  Test  B  are 

quite  similar  to  those  for  Stationarity  Test  B  developed  in  this  section. 

Both  tests  are  based  upon  an  analysis  of  the  variability  of  mean  square 

estimates.  The  only  difference  is  that  Randomness  Test  B  employs  a 
2 

lower  tail  x  test,  as  given  by  Eq.  (15.  26),  while  Stationarity  Test  B 

2 

uses  an  upper  tail  x  test,  as  given  by  Eq.  (16.  18).  It  is  obvious  that 
the  two  tests  can  readily  be  combined  into  a  single  hypothesis  test  for 
both  randomness  and  stationarity. 

Assume  a  collection  of  N  independent  mean  square  values, 

~2 

X.  (i  =  1,  2,  3,  .  .  .  ,  N),  are  measured  from  a  stationary  random  vibration 

^  2 
response  signal.  Let  the  theoretical  expected  normalized  variance  6  , 

A  2 

and  the  statistical  estimated  normalized  variance  e  be  computed  using 
Eqs.  (16.  13)  and  (16.  15),  respectively.  The  following  probability 
statement  may  be  made. 


Prob 


^(l-a/2) 

N 


=  (1  -Q) 


(16.  39) 


Thus,  if  it  is  hypothesized  that  the  collection  of  mean  square  esti¬ 
mates  were  obtained  from  a  random  and  stationary  signal,  the  region 
of  acceptance  for  a  test  of  the  double  hypothesis  at  the  o  level  of 
significance  is  given  by 


^(l-a/2) 

N 


(16.  40) 


A  plot  of  the  acceptance  regions  of  the  normalized  variance  ratio  for 
various  values  of  a  and  N  is  shown  in  Figure  16.  6. 

2 

It  should  be  noted  in  Eq.  (16.  40)  that  the  upper  and  lower  x 
limits  are  based  upon  a/2  rather  than  a  as  in  Randomness  Test  B 
or  Stationarity  Test  B.  Thus,  the  upper  limit  of  Eq.  (16.  40)  is  higher 
than  the  limit  for  Stationarity  Test  B  alone,  as  given  by  Eq.  (16.  18). 
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Figure  16.6  Acceptance  Regions  for  Combined  Randomness  and  Stationarity  Test 


Similarly,  the  lower  limit  of  Eq.  (16.  40)  is  lower  than  the  limit  for 
Randomness  Test  B  alone,  as  given  by  Eq.  (15.  26).  Hence,  application 
of  the  combined  test  at  a  given  level  of  significance  a  will  involve  a 
wider  region  of  acceptance  than  for  the  two  individual  tests.  This  is  to 
be  expected  since  the  probabilities  of  Type  I  errors  for  the  individual 
tests  are  effectively  pooled  into  a  single  Type  I  error  probability  for  the 
combined  test.  The  net  result  is  that  more  measurements  are  required 
for  the  combined  test  than  for  each  individual  test  if  the  same  Type  II 
error  limitations  are  to  be  maintained. 

The  combined  test  for  randomness  and  stationarity  does  pose  one 
practical  consideration.  Randomness  Test  B  is  most  effective  when 
applied  to  narrow  frequency  ranges  obtained  by  locating  a  narrow  band¬ 
width  filter  over  a  sharp  peak  in  the  power  spectrum  of  the  signal.  On 
the  other  hand,  Stationarity  Test  B,  as  any  test  for  stationarity,  should 
ideally  be  applied  to  the  entire  frequency  range  of  the  signal.  If  no  peaks 
appear  in  the  power  spectrum,  a  quantitative  test  for  randomness  is 
usually  not  needed  as  is  discussed  in  Section  15.  5.  3.  For  this  case, 
the  combined  test  is  not  really  applicable.  However,  if  one  or  more  sharp 
peaks  are  present  in  the  power  spectrum,  the  signal  should  be  tested  for 
both  randomness  and  stationarity.  For  this  case,  it  is  often  acceptable 
to  apply  the  combined  test  to  the  narrow  frequency  range  of  the  peaks, 
as  would  be  done  with  Randomness  Test  B  alone.  Most  of  the  relative 
power  of  the  vibration  response  represented  by  the  signal  being  analyzed 
will  be  in  the  sharp  power  spectral  density  peaks.  If  the  peadcs  in  the 
power  spectrum  are  shown  to  be  stationary,  it  is  reasonable  to  assume 
the  entire  signal  is  stationary  for  most  engineering  applications. 
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16,6  CONCLUSIONS 

Three  different  procedures  for  testing  single  sample  records  for 
stationarity  have  been  experimentally  evaluated.  One  of  the  procedures 
(Test  A)  is  the  stationarity  test  originally  proposed  in  Section  6.  1.  8  of 
Ref.  The  other  two  procedures  (Tests  B  and  C)  are  based  upon 

more  recent  concepts  developed  herein. 

The  experimental  results  confirm  the  validity  of  the  theory  for 
Stationarity  Test  A,  as  developed  in  Ref,  ^  ij  .  However,  the  results 
also  indicate  Test  A  is  less  powerful  and  more  complicated  than  the 
other  two  tests  proposed  in  this  section.  Thus,  it  is  recommended  that 
Stationarity  Test  A  from  Ref.  ^  l|  be  dropped  in  favor  of  either  of  the  two 
additional  tests  for  stationarity  presented  here. 

For  situations  of  repeated  flights  (multiple  points)  where  a  number 
of  different  sample  records  are  available,  a  fourth  test  for  stationarity 
is  illustrated  herein  based  on  one  way  analysis  of  variance  procedures, 
presented  in  Section  8.  The  results  demonstrate  that  analysis  of 
variance  procedures  will  detect  nonstationarities  in  repeated  experi¬ 
ments  with  great  power. 
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17.  TESTS  FOR  NORMALITY 


17.  1  THEORY  OF  TESTS  FOR  NORMALITY 
17.  1.  1  General  Remarks 

A  random  signal  is  said  to  be  normal  or  Gaussian  when  it  has 
a  specific  amplitude  probability  density  function  as  defined  by  Eq.  (11.  4) 
in  Section  11.  4.  2.  For  signals  with  a  mean  value  |x^  s  0,  Eq.  (11.  4) 
becomes 


Po(*)  = 


2/,  2 
-X  12a 

X 


(17.  1) 


where  is  the  mean  square  value  and  is  the  root  mean  square 
(rms)  value  for  the  signal. 

Two  quantitative  procedures  for  testing  a  single  random  signal 
record  for  normality  are  suggested  in  Ref. ^  1  j.  The  first  procedure, 
which  is  outlined  in  Section  5.  3.  2  of  Ref.  ^  ^  classical  "chi- 

squared  goodness  of  fit"  test  for  normality.  The  "goodness  of  fit"  test 
is  hereafter  referred  to  as  Normality  Test  A. 

The  second  procedure,  which  is  proposed  in  Section  6.  1.  10  of 
Ref.  ^  l|,  involves  the  analysis  of  analog  probability  density  estimates. 
More  specifically,  a  probability  interval  for  the  values  of  a  measured 
probability  density  estimate  ^(x)  is  established  based  upon  the  assump¬ 
tion  that  the  true  probability  density  function  being  measured  is  Gaussian. 
The  number  of  times  that  the  estimate  p(x)  falls  outside  this  probability 
interval  (a  failure)  for  measurements  at  many  different  amplitudes  x 
is  counted.  By  considering  the  number  of  failures  to  have  a  binomial 
sampling  distribution,  a  hypothesis  of  normality  may  be  tested.  The 
general  procedure  is  identical  in  concept  and  application  to  the  procedure 
developed  and  studied  in  Section  16  as  Stationarity  Test  A.  The  validity 
of  the  general  procedure  is  substantiated  in  Section  16.  However, 
Stationarity  Test  A  in  Section  16  was  found  to  be  relatively  complicated 
to  apply  and  weak  in  terms  of  detecting  conditions  of  nonstationarity. 
Because  of  the  strong  similarity  in  concept  and  application,  the  same 
conclusions  would  undoubtedly  apply  to  the  test  for  normality  proposed 
in  Section  6.  1.  10  of  Ref.^  1  j  . 

A  practical  modification  of  the  normality  test  originally  suggested  in 
Section  6.  1.  10  is  proposed  here.  This  test  involves  the  individual  testing 
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of  probability  density  estimates  at  different  amplitudes,  and  is  hereaifter 
referred  to  as  Normality  Test  B. 

17.  1.  2  Review  of  Normality  Test  A 

The  simplest  test  for  normality  is  the  classical  .chi-squared 
"goodness  of  fit"  test.  The  "goodness  of  fit"  test  is  applicable  to  ampli¬ 
tude  values  from  the  sample  record  and,  thus,  requires  no  special 
measurements  or  instruments.  It  is  necessary  only  to  reduce  the 
amplitude  time  history  from  the  sample  record  to  a  digital  form.  It  is 
not  necessary  to  discuss  the  theory  and  application  of  the  "goodness  of 
fit"  test  here  since  these  discussions  are  available  with  a  detailed 
illustration  in  Section  5.  3.  2  of  Ref .  ^  l| ,  as  well  as  in  most  statistics 
books.  Furthermore,  the  application  of  the  "goodness  of  fit"  test  to  real 
data  is  illustrated  in  Section  14.  4.  5  of  this  report,  where  it  is  employed 
to  test  a  collection  of  probability  density  estimates  for  normality. 


17.  1.  3  Principles  of  Normality  Test  B 

Consider  a  stationary  random  signal  x(t)  which  hypothetically 
exists  over  all  time.  Let  x(t)  have  an  amplitude  probability  density 
function  p{x)  with  a  mean  value  of  zero.  Further  assume  that  the  equiva¬ 
lent  ideal  frequency  bandwidth  B  is  at  least  one -third  the  number  of  zero 
crossings  per  second  .  Then,  a  measured  probability  density  estimate 
‘p(x)  will  have  a  normalized  variance  and  standard  error  as  given  in 
Section  14.  5  as  follows. 


2 

( 


0.  068 

Axp(x)  VqT^ 


(17.  2a) 


0.  26 

VAx^(x)[7oTj 


(17.  2b) 


As  in  Section  14,  Ax  is  the  amplitude  window  used  for  the  analysis,  ^(x) 
is  the  probability  density  measured  at  an  amplitude  x,  ^  is  the  number 
of  zero  crossings  per  second,  and  T^  is  the  averaging  time. 

It  is  shown  in  Section  14  that  probability  density  estimates  may  be 
considered  to  be  normally  distributed  about  the  true  probability  density 
at  any  specified  amplitude.  Then,  a  measurement  for  the  specific 
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amplitude  x  =  v  will  have  a  sampling  distribution  given  by 

(Py  -  Py)  Normal  (€  p^)  (17.3) 

where  "  "  means  "distributed  as,  "  and  Normal  (  «  p^)  is  a  normal 

distribution  with  a  mean  of  zero  and  a  standard  deviation  of  e  p  (a 

2  2  '' 
variance  of  «  Py  )•  From  Eq.  ( 17.  3),  the  following  probability  statement 

can  be  made. 

Prob  j^-(«  p^)z^/2  =  <Pv  ■  Pv^  =  Pv)®q/2  (‘^.4) 

where  *^^^2  normal  deviate  for  q/2. 

Let  it  be  hypothesized  that  a  sample  random  signal  record  has  a 
Gaussian  amplitude  probability  density  function,  Pq(x).  If  this  is  true, 
p(x)  =  Pq(^)*  hypothesis  Hq  is 

Hq  :  P^  =  p^y  for  any  amplitude  x  =  v  (17.  5) 

If  the  signal  is  not  Gaussian,  p^  may  be  greater  or  less  than  p^^  as 
defined  in  Eq.  (17.  1),  which  is  why  a  two-sided  probability  statement 
is  used  in  Eq.  (17.  4).  Then  Hq  is  tested  by  computing  <  in  Eq.  (17.  2b) 
using  Pq^>  stod  comparing  the  difference  (p^  -  p^^  )  to  the  limits  in 
Eq.  (17.  4)  for  any  desired  level  of  significance  a.  The  region  of 
acceptance  for  Hq  is 

|p-p  l2(*p)z/,  (17.6) 

I  *^v  *^ovl  '  *^ov'  a/ 2  '  ' 

If  the  absolute  value  of  the  difference.  Ip  -  p  | ,  is  less  than  the  noted 
limit,  Hq  is  accepted  and  the  random  signal  is  considered  to  have  a 
Gaussian  probability  density  at  the  amplitude  x  =  v.  If|  "  Pqv  I 
greater  than  the  noted  limit,  Hq  is  rejected  and  there  is  reason  to  sus¬ 
pect  that  the  signal  is  not  Gaussian  at  the  amplitude  x  =  v.  The 
hypothesis  Hq  may  be  tested  fo^  as  many  different  amplitudes  x  as 
desired. 

The  probability  of  a  Type  I  error  is  a  for  each  amplitude  tested. 

The  probability  of  a  Type  II  error,  P,  is  a  function  of  the  level  of 
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significance  a,  the  standard  deviation  e  Pq^.'  non-Gaussian 

probability  density  which  one  wishes  to  detect  with  a  probability  of 
p.  Unfortunately,  conventional  Operating  Characteristics  (OC)  curves 
are  not  readily  applicable  to  this  problem  because  the  measurement 
standard  deviation  is  given  by  a  composite  value  e  p^^  rather  than  by  a 
distinct  population  standard  deviation  and  sample  size.  However,  for 
a  normal  sampling  distribution,  the  risk  of  a  Type  II  error  for  detect¬ 
ing  a  difference  |p^  -  p^^j  =  (  €  p^^)  always  P  =  0,  50.  This 

point  is  illustrated  in  Figure  17.  1.  It  is  clear  that  P  =  0.  50  since 
exactly  half  of  the  normal  distribution  is  covered  at  either  extreme. 


4  region  of  acceptance 


Region  of  Type  I  error  a 
Region  of  Type  II  error  P  =  0.  50 

Figure  17.  1  Probable  Type  I  and  Type  II  Errors 
for  Normality  Test  B 

It  is  important  to  note  that  the  a  and  P  risks  are  determined  by 
( €  p^^)  which  in  turn  is  determined  by  the  record  length  T  and  the 
amplitude  x  =  v  at  which  the  test  is  to  be  applied.  Thus,  if  a  pre¬ 
determined  a  and  P  risk  are  desired,  these  matters  must  be  considered 
to  arrive  at  the  necessary  record  length  T  to  be  obtained. 
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One  problem  remains  to  be  resolved.  In  practice,  Normality  Test 
B  will  actually  require  that  many  different  amplitudes  be  tested  as  part 
of  one  general  test  for  normality  of  a  single  sample  record.  To  permit 
an  easy  test  decision,  it  is  desirable  that  a  general  hypothesis  of 
normality  be  rejected  if  the  test  at  any  one  individual  amplitude  produces 
a  rejection.  However,  if  N  number  of  amplitudes  are  tested,  each  at 
the  a  level  of  significance,  it  is  obvious  that  the  probability  of  at  least 
one  Type  I  error  is  considerably  greater  than  a.  This  probability  of 
at  least  one  Type  I  error,  denoted  by  a'  ,  is  developed  as  follows. 

Assume  a  signal  with  a  true  Gaussian  probability  density  function 
is  sampled  and  tested  for  normality  at  N  number  of  different  ampli¬ 
tudes.  If  each  amplitude  is  tested  at  the  a  level  of  significance,  the 
probability  of  correctly  accepting  a  normality  hypothesis  at  each  ampli¬ 
tude  is,  of  course,  (1  -  a).  Thus,  the  probability  of  accepting  the 

N 

normality  hypothesis  at  all  N  amplitudes  is  (1  -  a)  .  It  follows  that 
the  probability  of  making  at  least  one  Type  I  error  for  the  N  number 
of  tests  is 

Q'  =  1  -  (1  -  a)^  (17.  7) 

Equation  ( 17.  7)  defines  the  over-all  probability  of  a  Type  I  error  for 
Randomness  Test  B.  If  a  Type  I  error  probability  of  a'  is  desired 
for  the  over -all  test,  each  of  the  N  number  of  amplitudes  must  be 
tested  at  the  a  level  of  significance  given  by 

1/N 

a  =  1  -  (1  -  o')  (17.  8) 

In  summary,  the  procedure  for  applying  Normality  Test  B  is  as 
follows. 

1.  Establish  the  desired  value  of  o'  ,  the  risk  of  making  a 

Type  I  error,  and  the  number  of  aimplitudes  N  which 
are  to  be  tested.  Compute  the  level  of  significance  a 
for  the  test  at  each  amplitude  using  Eq.  (17.  8). 

2.  Establish  the  deviation  from  normality,  |  p^  -  |  * 

which  is  to  be  detected  at  each  amplitude  with  a 
probability  of  p  =  0.  50. 
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3.  Using  a  table  of  normal  deviates,  determine  the  value  for 

^a/2  • 

4.  Using  a  table  of  normal  ordinates,  determine  the  Gaussian 

probability  for  the  maximum  amplitude  x  =  v(max)  to 

be  tested. 

5.  Determine  the  required  value  for  c  by  letting 

p  -p  =(<P  )z  /■>. 

*^v  *^ov  ^ov  a/ 2 

6.  Solve  for  in  Eq.  (17.  2)  using  p(x)  =  p^^  and  an  esti¬ 
mate  for  Vq  ■  The  sample  record  to  be  obtained  must 
have  a  length  of  T^T^. 

7.  Measure  the  probability  density  estimates  p^  from  the 
sample  record  at  the  N  number  of  required  amplitudes, 
and  test  the  hypothesis  Hq  in  Eq.  (17.  5)  using  the  accept¬ 
ance  region  in  Eq.  (17.  6). 

8.  If  a  rejection  is  obtained  at  any  one  of  the  N  number  of 
amplitudes  tested,  there  is  reason  to  believe  the  sample 
record  was  not  obtained  from  a  signal  with  a  Gaussian 
probability  density  function. 

Example: 

The  above  discussions  will  be  clarified  by  considering  a  specific 
excunple.  The  example  used  is  an  actual  case  which  is  studied  herein 
experimentally. 

Assume  a  signal  representing  a  stationary  random  vibration 
response  is  to  be  sampled  so  that  a  test  for  normality  may  be  performed 
for  amplitudes  out  to  2.  5  times  the  root  mean  square  value  for  the 
signal  (2.  5  <r^).  The  expected  number  of  zero  crossings  per  second 
for  the  signal  is  Vq  -  788.  The  amplitude  window  width  of  the  analyzer 
to  be  used  is  0.  1  for  an  input  signal  level  of  (r^  =  unity.  Symmetry 
is  assumed  so  that  only  N  =  6  positive  amplitudes  will  be  tested 
(v  =  0,  0.5o-  ,  l.Ocr  ,  1.5<r  ,  2.0cr  ,  and  2.5(r  ).  It  is  desired  that 

X  X  X  X  X 

the  Type  I  error  probability  for  the  entire  test  be  a'  =  0.05,  and  that 
a  i  25%  deviation  from  normality  at  any  of  the  six  amplitudes  be 
detected  with  P  =  0,50  probability  of  a  Type  II  error. 
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From  Eq.  (17.  8),  for  a'  =  0.05  and  N  =  6,  the  required  level  of 
significance  for  the  test  at  each  amplitude  is  a  0.01.  From  a  table  of 
normal  deviates  (  Ref. 


Table  II),  =  Z.  ioT  a  >4  0.01.  From  a 


table  of  normal  ordinates  (Ref.  2j,  Table  I),  for  v  =  2.  5(r^,  =  0.0175. 

Thus,  for  a  ±  25' 
of  <  is  given  by 


Thus,  for  a±  25%  deviation,  1  p  -p 

I  ‘^v  ov 


=  0.  25  p^^,  and  the  required  value 


c  = 


o  -  p 
*  V  ov 


p  ®  /-> 
*^ov  a/ 2 


0.  25  p 


ov 


=  0.  1 


2.  6 


ov 


From  Eq.  (17.  2),  the  averaging  time  T^  required  for  the  maximum 
amplitude  (v  =  2.  is  determined  to  be 

0.068  0.068 

T.  =  — - - ^  =  -  =  5  seconds 

Axp^^  Vq  (0.01)(0.  1)(0.0175)(788) 

Thus,  a  sample  record  length  of  at  least  T  =  5  seconds  is  required.  It 
is  interesting  to  note  that  if  the  test  were  to  be  performed  with  the  same 
a'  and  P  risks  out  to  3cr^,  the  required  record  length  would  be  T  ft  20 
seconds.  Out  to  4<r^,  the  required  record  length  would  be  T  «  45  seconds. 

To  actually  perform  the  test  for  normality,  a  probability  density 
estimate  p^  must  be  measured  at  each  of  the  six  amplitudes  to  be  tested. 
The  region  of  acceptance  for  the  normality  hypothesis  Hq  at  each  ampli¬ 
tude  V  is 

Ip  -p  |2(€P  )z,,  =  0.  26p 

V  *^ov  *^ov  a/ 2  *^ov 

Note  that  the  measured  estimates  p  should  all  have  the  same  normalized 
2 

variance  (  e  =  0.01)  if  the  same  Type  I  and  Type  II  error  limits  are  to 
be  maintained  at  all  amplitudes.  However,  is  inversely  proportional 

to  p^.  Thus,  from  Eq.  (17.2),  the  required  averaging  time  T  becomes 
shorter  as  the  amplitude  being  tested  becomes  smaller.  For  the 
example  at  hand,  the  required  averaging  times  and  acceptance  regions 
are  summarized  in  Table  17.  1. 
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Limits  of  Acceptance  Region  for  Hq:p^=  p^^ 

Ax  =  0. 1  (T^ ;  =  788  crossings  per  second;  a'  =  0,05;  a  ^0.01 


P  =  0.  50  for  detecting  a  25%  deviation  from  normality 


Amplitude 

V 

Gaussian 

Probability 

p 

*^ov 

Normalized 

Standard 

Error 

c 

Required 

Averaging 

Time 

T .  seconds 

1 

Limit  for 
Acceptance 
Region 

0.26  p 

^ov 

0 

0.  399 

0.  1 

0.  10 

0.  5(r 

X 

0.  352 

0.  1 

1.  Oa 

X 

0.  242 

0.  1 

0.  36 

1.  5(r 

X 

0.  130 

0.  1 

0.  66 

0.  034 

MBM 

0. 0540 

0.  1 

1.  6 

0.  014 

0.  0175 

0.  1 

5.  0 

0.  0045 

Table  17.  1  Limits  of  Acceptance  Region  for  Normality  Test  B 
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17.  2 


DESIGN  OF  EXPERIMENTS  AND  PROCEDURES 


A  comprehensive  experimental  study  of  the  two  normality  tests 
discussed  in  Section  17.  1  is  not  really  feasible  since  a  random  signal 
which  has  an  exact  Gaussian  probability  density  function  at  all  amplitudes 
is  unattainable.  However,  there  is  little  reason  to  question  either  the 
theoretical  foundation  or  practical  applicability  of  the  two  tests. 

Normality  Test  A  (chi-squared  goodness  of  fit  test)  is  a  classical  procedure 
which  has  been  widely  applied  for  years  to  many  problems  including  digital 
vibration  data  analysis.  Normality  Test  B  is  based  solely  upon  the  un¬ 
certainty  of  analog  probability  density  estimates  which  is  studied  in  detail 
in  Section  14. 

It  will  be  sufficient  here  to  illustrate  Normality  Test  B  by  applying 
the  test  to  probability  density  data  gathered  in  Section  14.  Specifically, 
consider  the  data  presented  under  A-3  in  Table  14.  2  and  B-1  through  B-5 
in  Table  14.  3.  These  data  represent  probability  density  estimates  for 
amplitudes  of  v  =  0  {A-3),  0.  5cr^(B-l),  1.0(r^(B-2),  1.5o’^(B-3), 

2.  0<r^(B-4),  and  2.  5(r^(B-5)  with  the  following  test  parameter's. 


1 .  a  =  1 .  00  volts 

X 

2.  Ax  =  0.  100  volts 

3.  f^  =  95  cps  ;  f|^  =  630  cps 


f  ^  +  f  f.  +  f;f 

a  a  b  b 


=  788  crossings  per  second 


4.  Tj  =  2K  =  0.  218  seconds  per  esti 


stimate 


Let  it  be  hypothesized  that  the  random  noise  generator  used  for 
the  experiments  in  Section  14  (Item  A,  Table  14.  1)  produces  a  random 
signal  with  a  true  Gaussian  probability  density  function.  The  hypothesis 
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of  normality,  Hq  ,  is  to  be  tested  at  six  amplitudes  from  0  to  2.  5  volts 
(cr^  =  unity)  at  the  a'  =  0.05  level  of  significance.  It  is  desired  that  a 
25%  deviation  from  a  Gaussian  probability  density  be  detected  with  a 
probability  of  P  =  0.50.  Note  that  these  requirements  and  parameters 
are  exactly  the  same  as  used  for  the  example  in  Section  17.1.  From 
that  example,  the  required  averaging  times  and  the  resulting  accept¬ 
ance  regions  for  Hq  are  as  given  in  Table  17.  1. 

An  estimate  p^  averaged  over  the  desired  time  intervals  may 
be  obtained  from  Table  14.  2  and  14.  3  by  averaging  together  as  many 
estimates  based  on  T  ^  =  0.  218  seconds  as  required  for  each  of  the 
six  amplitudes  of  interest. 

17.  3  INSTRUMENTATION 

The  instruments  and  test  set-up  are  detailed  in  Section  14.  3. 

17.  4  RESULTS  OF  EXPERIMENTS 
17.4.1  Probability  Density  Data 

The  probability  density  estimates  for  the  six  amplitudes  of 
interest  are  presented  in  Table  17.2.  Each  estimate  p^  is  obtained 
by  averaging,  from  the  top  down,  the  required  number  of  values 
presented  in  the  appropriate  columns  of  Tables  14.  2  and  14.  3  of 
Section  14. 


Probability  Density  Estimates  p 

for  Different  Amplitudes  v 

a  =  1.  00  volts;  A 

X 

X  =  0.  100  volts 

Uq  =  788  crossings  per  second 

Amplitude  v  (volts) 

probability  density  p^ 

0 

(A-3,  Table  14.  2) 

0.  385 

0.  5 

(B-1,  Table  14.  3) 

0.  400 

1.  0 

(B-2,  Table  14.  3) 

0.  260 

1.  5 

(B-3,  Table  14.  3) 

0.  101 

2.  0 

(B-4,  Table  14.  3) 

0.  0418 

2.  5 

(B-5,  Table  14.  3) 

0.  0141 

Table  17.  2  Probability  Density  Data  for  Normality  Test  B 
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17.4.2  Test  for  Normality 

Using  the  data  presented  in  Tables  17.  1  and  17.  Z,  the  random 
noise  generator  is  tested  for  normality  by  application  of  Normality 
Test  B  at  the  a'  =  0.  05  level  of  significance,  as  summarized  in 
Table  17.  3. 


Results  of  Test  for  Normality  of  Signal  from  Random  Noise  Generator 

Estimated 

Probability 

Density 

Gaussian 

Probability 

Density 

Limit  of 
Acceptance 
Region  for 

Test  of 

amplitude 

Table  17.  2 

Table  17.  1 

1  p  -  p  1 

^  ^ov 

1  p  -  p  1 

:  p  =  p 

V 

A. 

Pv 

p 

Table  17.  1 

m 

0.  399 

0.  014 

0.  10 

accepted 

■MH 

0.  352 

0.  092 

accepted 

0.  260 

0.  242 

0.  063 

accepted 

1.  5 

0.  101 

0.  130 

mm 

0.  034 

accepted 

2.  0 

0.  0418 

0.  0540 

0.  0122 

0.014 

accepted 

2.  5 

0.  0141 

0.0175 

0.  0034 

0.  0046 

accepted 

Table  17.  3  Results  of  Test  for  Normality 


From  Table  17.  3,  it  is  seen  that  the  hypothesis  of  normality 
at  the  six  specific  amplitudes  tested  is  accepted.  Thus,  the  general 
hypothesis  of  normality  for  the  random  signal  is  accepted. 
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17.  5  DISCUSSION  OF  RESULTS 


The  results  presented  in  Table  17.  3  indicate  the  random  noise 
generator  employed  for  the  experiments  in  this  report  produces  a 
signal  which  is  Gaussian  within  the  Type  II  error  limits  of  the  normality 
test  performed  ((3  =  0.50  for  detecting  a  25%  deviation  from  normality 
at  each  amplitude  tested).  This  does  not  necessarily  mean  that  the 
signal  from  the  noise  generator  is  exactly  Gaussian.  It  is  quite  possible 
that  a  hypothesis  of  normality  would  be  rejected  if  the  test  were  per¬ 
formed  with  a  more  stringent  Type  II  error  limitation.  However,  for  the 
experiments  performed  in  this  report,  the  Type  II  error  requirements 
used  for  the  normality  test  in  Section  17.  4.  2  are  sufficient  to  justify  the 
qualitative  statement  that  the  noise  generator  produces  an  "approximately 
Gaussian"  signal. 

A  plot  of  the  probability  density  function  for  the  signal  from  the 
random  noise  generator  is  presented  in  Figure  14.  3  of  Section  14.  The 
ideal  Gaussian  probability  density  function  is  shown  on  the  same  scale. 
The  results  there  clearly  show  the  strong  Gaussian  tendencies  of  the 
noise  generator  signal. 

17.6  CONCLUSIONS 

Two  different  procedures  for  testing  single  sample  records  for 
normality  have  been  reviewed.  One  of  the  procedures  (Test  A)  is  the 
"chi- squared  goodness  of  fit"  test  outlined  in  Section  5.  3.  2  of  Ref.  ^  l|. 
The  other  procedure  (Test  B)  is  a  modification  of  the  normality  test 
originally  proposed  in  Section  6.  1.  10  of  Ref.  j- 

Normality  Test  A  is  applicable  to  amplitude  time  history  data  in 
digital  form.  Normality  Test  B  is  applicable  to  analog  probability 
density  estimates.  The  probability  density  data  obtained  for  experi¬ 
ments  in  Section  14  is  used  here  to  illustrate  the  application  of  Test  B 
to  real  data.  Both  procedures  are  believed  to  be  practical  for  application 
to  flight  vehicle  vibration  data. 
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18.  CONCLUSIONS  AND  RECOMMENDATIONS 


FROM  EXPERIMENTAL  PROGRAM 

The  general  objectives  of  the  studies  presented  in  this  report  and  a 
brief  summary  of  main  results  are  stated  in  Section  1.  Part  I  of  the 
report,  consisting  of  the  first  ten  sections,  'is  concerned  with  analytical 
studies  which  are  reviewed  in  the  conclusions  and  recommendations  of 
Section  10.  Part  II  of  the  report,  consisting  of  Sections  11  through  18,  is 
concerned  with  experimental  studies  which  are  terminated  by  the  conclusions 
and  recommendations  presented  here.  An  introduction  to  the  experimental 
program,  including  the  necessary  background  material,  is  presented  in 
Section  11.  These  experimental  studies  are  based  upon  data  analyzed  by 
analog  instruments.  However,  the  results  and  conclusions  are  directly 
applicable  to  data  analyzed  using  digital  techniques,  except  where  noted. 

It  should  also  be  recognized  that  the  statistical  procedures  employed  to 
evaluate  the  experimental  results  have  broad  applications  to  many  general 
data  analysis  problems  for  other  physical  areas. 

18.  1  REVIEW  OF  EXPERIMENTAL  PROGRAM 
Section  12.  Uncertainty  of  Zero  Crossing  Estimates 

Theoretical  studies  are  reviewed  which  deal  with  the  application  of 
statistical  run  theory  to  the  prediction  of  the  sampling  distribution  for 
random  signal  zero  crossings.  Experiments  are  performed  involving  three 
types  of  signals;  (1)  random  signals  with  uniform  power  spectra, 

(2)  random  signals  with  non-uniform  power  spectra,  (3)  nonrandom 
signals  consisting  of  a  sine  wave  plus  noise.  Experimental  zero  crossing 
measurements  are  compared  to  theoretical  predictions  by  carefully 
designed  statistical  tests. 

The  results  confirm  that  run  theory  is  applicable  to  the  zero  cross¬ 
ing  problem.  The  sampling  mean  and  variance  for  the  zero  crossings  of 
a  random  signal  are  predicted  correctly  when  the  signal  has  a  reasonably 
uniform  power  spectrum.  Furthermore,  the  presence  of  a  sine  wave  in 
an  otherwise  random  signal  significantly  alters  the  resulting  zero  cross¬ 
ings,  which  indicates  possible  applications  of  run  theory  to  a  test  for 
randomness.  However,  sharp  peaks  in  the  power  spectrum  of  a  random 
signal  also  alters  the  resulting  zero  crossings. 

An  important  conclusion  of  this  section  is  as  follows.  Given  a 
stationary  random  signal  with  a  uniform  power  spectrum  between  the 
frequencies  f^  and  f^,  the  sampling  distribution  for  the  zero  crossings 


ASD  TDR  62-973 


18-1 


measured  from  a  sample  record  of  length  T  (seconds)  will  have  a 
mean  and  variance 


where 


n 

2 


2(n.  1) 


n=  ZVq'T 


If  ^  +  f  f .  +  f  K 
a  a  b  b 


Section  13.  Uncertainty  of  Power  Spectra  (Mean  Square)  Estimates 

Theoretical  studies  are  reviewed  which  deal  with  the  sampling 
distribution  for  power  spectra  estimates  measured  from  sample  records 
of  random  signals.  Experiments  are  performed  involving  analog  power 
spectra  measurements  for  a  wide  range  of  frequency  bandwidths,  center 
frequencies,  and  averaging  times.  The  experimental  results  are  in 
complete  agreement  with  the  theoretical  prediction  for  the  variance  of 
power  spectra  estimates. 

An  important  conclusion  of  this  section  is  as  follows.  Given  a 
stationary  random  signal,  the  sampling  distribution  for  a  power  spectral 
density  estimate  G(f)  measured  from  a  sample  record  of  length  T 
(seconds)  will  have  a  normalized  variance 


2 

c 


G^f) 


1 

BT 


Here,  B  is  the  frequency  bandwidth  in  cps  of  the  narrow  band  pass 
filter  used  for  the  analysis. 

The  study  of  power  spectra  measurements  is  extended  to  cover 
mean  square  level  estimates.  General  expressions  are  developed  for 
the  sampling  distribution  variance  of  wide  bandwidth  mean  square  value 
e  stimates. 
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Section  14.  Uncertainty  of  Probability  Density  Estimates 

Previous  theoretical  studies  are  reviewed  and  extended  for  the 
sampling  distribution  of  amplitude  probability  density  estimates.  Two 
slightly  different  theoretical  expressions  for  the  variance  of  probability 
density  estimates  are  obtained.  Experiments  are  performed  involving 
analog  probability  density  measurements  for  a  wide  range  of  frequency 
characteristics  and  averaging  times. 

For  many  practical  conditions,  the  experimental  results  indicate 
that  an  appropriate  expression  for  the  normalized  variance  of  projsability 
density  estimates  p(x)  measured  from  a  sample  record  of  length  T  (seconds) 
is  as  follows. 

2 

.  2  -  °'e(«)  „  O  PT, 

p^x)  ~ 

Here, Ax  is  the  width  of  the  amplitude  window  used  for  the  analysis,  and 
Vq  is  the  expected  number  of  zero  crossings  per  second. 

For  those  cases  where  the  random  signal  has  a  narrow  bandwidth, 
the  experimental  results  indicate  that  a  more  valid  representation  for 
the  normalized  variance  of  probability  density  estimates  is  as  follows. 

p^x)  ^-pWbt 

Here,  B  is  the  equivalent  ideal  frequency  bandwidth  in  cps. 

It  is  believed  that  the  true  expression  for  the  sampling  distribution 
variance  of  probability  density  estimates  is  more  general,  and  perhaps 
involves  more  terms  than  the  expressions  developed  and  studied  in  this 
section.  These  matters  are  not  completely  resolved. 
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Section  15.  Tests  for  Randomness 


Two  different  quantitative  procedures  for  testing  individual  sample 
records  for  randomness  are  studied.  One  of  the  procedures  (Test  A) 
is  the  randomness  test  proposed  originally,  and  is  based  upon  an  analysis 
of  the  zero  crossings  measured  from  a  sample  record.  The  second 
procedure  (Test  B)  is  based  upon  theoretical  ideas  developed  herein 
involving  an  analysis  of  the  variability  of  mean  square  value  measure¬ 
ments.  Experimental  data  gathered  for  the  studies  in  Section  12,  as 
well  as  additional  experiments  performed  in  this  section,  are  employed 
to  confirm  the  basic  theory  of  the  two  tests  and  to  evaluate  their  relative 
effectiveness. 

The  experimental  results  are  in  agreement  with  theoretical  pre¬ 
dictions.  Randomness  Test  A  is  shown  to  be  a  powerful  technique  for 
detecting  sine  waves  in  an  otherwise  random  signal,  under  ideal 
conditions.  However,  the  results  also  indicate  Test  A  will  erroneously 
reject  random  signals  as  being  nonrandom  unless  the  power  spectra  of 
the  signals  are  reasonably  uniform.  This  fact  makes  the  application 
of  Test  A  to  flight  vehicle  vibration  impractical  in  many  cases,  since 
such  data  rarely  have  uniform  power  spectra.  Randomness  Test  B 
proposed  in  this  section  does  not  present  the  above  problem.  Although 
Test  B  IS  less  powerful  for  detecting  sine  waves,  its  application  to 
flight  vehicle  vibration  data  is  more  practical.  It  is  recommended 
that  Randomness  Test  A  be  dropped  in  favor  of  the  new  Test  B  presented 
herein. 

Qualitative  techniques  for  evaluating  the  randomness  of  flight 
vehicle  vibration  data  are  also  discussed.  These  techniques  involve 
observation  of  certain  distinguishing  details  in  power  spectral  density 
functions,  autocorrelation  functions,  and  amplitude  probability  density 
functions.  These  qualitative  procedures  will  often  reveal  periodicities 
in  an  otherwise  random  vibration  without  the  need  for  quantitative 
testing  of  the  data. 
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Section  16.  Tests  for  Stationarity 


Three  separate  quantitative  procedures  for  testing  individual  sample 
records  for  stationarity  are  studied.  One  of  the  procedures  (Test  A)  is 
the  stationarity  test  proposed  originally.  The  other  two  procedures 
(Tests  B  and  C)  are  based  upon  concepts  developed  herein.  All  three 
procedures  involve  an  analysis  of  the  variability  of  mean  square  value 
measurements.  Extensive  experiments  are  performed  to  confirm  basic 
theoretical  ideas  and  to  evaluate  the  relative  effectiveness  of  the  three 
tests. 

The  experimental  results  are  in  agreement  with  theoretical  pre¬ 
dictions.  The  results  also  indicate  that  Stationarity  Test  A  is  the 
least  powerful  and  the  most  complicated  in  application  of  the  three 
tests.  It  is  recommended  that  Stationarity  Test  A  be  dropped  in  favor 
of  either  of  the  two  additional  tests  presented  herein. 

For  situations  where  data  is  collected  from  repeated  flights  (or 
from  multiple  points)  such  that  a  number  of  different  sample  records 
are  available,  a  fourth  test  for  stationarity  is  illustrated.  This  test  is 
based  upon  one-way  analysis  of  variance  procedures,  as  presented  in 
Section  8  of  this  report.  The  results  demonstrate  that  these  analysis- 
of -variance  procedures  will  detect  nonstationary  conditions  in  repeated 
experiments  with  great  power. 

Section  17.  Tests  for  Normality 

Two  different  quantitative  procedures  for  testing  individual  sample 
records  for  normality  are  considered.  One  procedure  (Test  A)  is  the 
"chi-squared  goodness  of  fit"  test.  The  other  procedure  (Test  B)  is  a 
practical  modification  of  the  test  for  normality  proposed  originally. 

Test  A  is  applicable  to  digital  amplitude  time  history  data,  while 
Test  B  is  applicable  to  analog  probability  density  data. 

Normality  Test  A  (goodness-of-fit  test)  is  a  classical  procedure 
which  requires  no  verification.  The  theoretical  basis  for  Test  B  is  sub¬ 
stantiated  by  experiments  performed  in  Section  14.  Experimental 
probability  density  data  gathered  in  Section  14  is  employed  to  illustrate 
the  practical  application  of  Normality  Test  B. 
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18.  2  RECOMMENDATIONS  FOR  FURTHER  EXPERIMENTAL  AND 
THEORETICAL  WORK  FROM  PART  II 

1.  The  analysis  of  extreme  and  peak  amplitude  values  is  an  area  in  need 
of  further  study.  Considerable  theoretical  and  experimental  work  is 
required  to  develop  suitable  techniques  for  estimating  extreme  and 
peak  values  from  relatively  short  sample  records.  These  matters 
are  of  major  importance  to  the  general  problem  of  flight  vehicle  struc¬ 
tural  reliability,  including  the  prediction  of  catastrophic  structural 
failures  due  to  extreme  loads  as  well  as  long  term  structural  damage 
due  to  fatigue. 

2.  The  theoretical  formulas  for  the  sampling  distribution  of  amplitude 
probability  density  estimates,  as  developed  in  Section  14  of  this  report, 
appear  to  be  incomplete.  Further  fundamental  study  is  needed,  along 
with  appropriate  experimental  verification.  The  discussions  and  data 
given  in  Section  14  present  a  sound  foundation  for  such  future  work. 

3.  Procedures  for  detecting  a  periodic  component  with  fixed  frequency  in 
an  otherwise  random  signal  are  well  developed  in  Section  15  of  this 
report.  However,  the  related  problem  of  detecting  a  periodic  com¬ 
ponent  with  changing  frequency  is  not  considered.  More  theoretical 
study  of  this  special  situation  is  needed,  followed  by  appropriate 
experimental  verification. 

4.  A  comprehensive  experimental  and  theoretical  program  should  be 
conducted  on  the  accuracy  of  transfer  function  measurements.  This 
will  require  development  of  tests  for  linearity,  based  upon  theoretical 
uncertainty  formulas  for  measuring  coherence  functions.  Transfer 
function  measurements  are  important  in  making  predictions  of  input- 
output  relations  for  linear  systems.  Inaccurate  estimates  of  transfer 
functions  can  lead  to  serious  design  problems. 

5.  The  sampling  distribution  for  correlation  measurements  is  well 
defined  for  time  displacements  near  zero,  since  the  correlation  func¬ 
tion  at  zero  delay  is  simply  a  mean  square  value.  However,  the 
sampling  distribution  for  correlation  measurements  at  large  time 
displacements  is  not  well  defined.  Additional  theoretical  studies  of 
this  problem  are  needed,  followed  by  experimental  verification. 
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